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IX  ABSTRACT  (JWffiCfrnum  200  wo«feJ 

During  Phase  I,  I-MATH  Associates,  Inc.  and  the  NYU  Courant  Institute  of  Mathematical  Sciences  have 
developed  algorithms  and  real-time  software  for  fusion  of  3D  imagery  and  information.  The  fundamental 
technique  is  geometric  hashing.  Hashing  is  an  efficient  method  for  storing  a  very  large  set  of  models, 
representing  various  target  types  and  poses,  and  then  quickly  determining  which  model  best  represents  an 
unknown  item,  whose  corresponding  features  are  sifted  through  the  hash  table. 


In  its  current  form,  hashing  represents  an  object's  (or  scene's)  feature  values  in  a  2D  table  whose 
abscissa  and  ordmate  correspond  to  the  feature  variables.  Typically,  such  features  are  (x,y)  geometric 
coordinates  of  key  interest  points  about  the  object  (scene).  However,  the  features  can  be  any  basis  function, 
including  affine  transforms  of  a  rigid  body,  radius  of  curvature  and  tangent  magnitude  of  curved  objects,  etc. 
Hence,  hashing  allows  disparate  types  of  information  to  be  placed  in  a  common  table.  The  overall  objective  of 
this  STTR  is  not  just  multidimensional  pattern  recognition,  but  rather  maximum  extraction  of  information  from 
multiple  sources,  which  may  be  dissimilar  and  perhaps  not  even  imaging.  Hashing  directly  supports  such 
fusion,  since  multiple  types  of  features  can  be  the  basis  for  an  nD  hash  table. 
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UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  PAGE _ 

The  thrust  of  this  STTR  development  has  been  to  devise  an  nth  order  hashing  schema,  beginning 
with  a  3D  implementation  for  Phase  1.  However,  our  approach  is  not  limited  to  extending  the  hash  table 
from  a  2D  to  3D  (or  higher  dimension)  domain.  We  have  also  investigated  alternative  techniques  during 
Phase  I,  including: 

•  Hashing  on  2D  plane  orthonormal  projections,  and  then  combining  the  results  using 
postclassifier  fusion  techniques 

•  Once  the  best  2D  match  is  made,  then  rotating  the  matched  plane  to  the  other  orthogonal 
planes  for  matching  refinement  by  performing  additional  hashing 

•  Combinations  of  the  above. 

Initially,  we  sought  to  port  the  ND  Hash  software  developed  by  NYU  into  the  Texas  Instruments 
Multimedia  Video  Processor  TMS320C8X  parallel  DSP  system  (C80).  This  task  was  unsuccessful  due  to 
the  large  amount  of  intra-memory  accesses  performed  by  the  NYU  algorithm.  However,  we  were  able  to 
implement  a  2D  hashing  algorithm  onto  a  simulation  of  the  C80.  This  provides  a  basis  for  hosting  the 
iterative  2D  projection  hashing  algorithms. 


PREFACE 


This  Phase  I  SBIR  project  was  performed  by  I-MATH  Associates,  Inc.,  for  which  the 
Principal  Investigator  was  Mr.  Ronald  Patton.  Significant  contributions  made  by  other  I-MATH 
personnel  were  the  implementation  of  2D  hashing  onto  the  TI  C80  processor  (Dr.  Harley  Myler, 
vidth  assistance  from  a  UCF  graduate  student,  Mosleh  Uddin),  the  feasibility  analysis  of  the 
Iterative  2D  Projection  Hashing  algorithms  (Liviu  Voicu),  and  processor  configuration 
evaluations,  particularly  the  GAPP/PAL  technology  (Herb  Arkin).  New  York  Univeristy 
developed  the  Generalized  ND  Hashing  software  and  demonstrated  its  feasibility  with  several 
examples  (graduate  student  Raju  Jawelekar,  under  the  direction  of  Dr.  Robert  Hummel). 

The  ARO  COTR  was  Dr.  Ming  C.  Lin,  (919)  549-4256,  lin@aro .ncren.net.  In  addition  to 
this  Final  Report,  interim  results  were  presented  at  the  ARO  Principal  Investigators  Meetings  on 
Computational  Mathematics,  Discrete  Mathematics,  and  Computer  Science  on  26-27  February 
1997;  Dr.  Myler  and  Mr.  Jawelakar  were  the  presenters.  A  Phase  II  proposal  was  submitted  on 
28  May  1997. 
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1.  INTRODUCTION 


During  Phase  I,  I-MATH  Associates,  Inc.  and  the  NYU  Courant  Institute  of 
Mathematical  Sciences  have  developed  algorithms  and  real-time  software  for  fusion  of  3D 
imagery  and  information.  The  fundamental  technique  is  geometric  hashing,  originally  conceived 
by  NYU’’^;  I-MATH  subsequently  applied  geometric  hashing  to  critical  military  applications.^’'* 
NYU  has  a  close  liaison  with  the  TJ  Watson  IBM  Research  Center,  a  significant  hashing 
contributor.^ 

In  its  current  form,  hashing  represents  an  object's  (or  scene's)  feature  values  in  a  2D  table 
whose  abscissa  and  ordinate  correspond  to  the  feature  variables.  Typically,  such  features  are 
(x,y)  geometric  coordinates  of  key  interest  points  about  the  object  (scene).  Some  examples  for 
Ladar  imagery  are  shown  in  Figure  1.  However,  the  features  can  be  any  basis  function, 
including  affine  transforms  of  a  rigid  body,^  radius  of  curvature  and  tangent  magnitude  of 
curved  objects,’  etc.  Hence,  hashing  allows  disparate  types  of  information  to  be  placed  in  a 
common  table. 

Hashing  is  an  efficient  method  for  storing  a  very  large  set  of  models,  representing  various 
target  types  and  poses,  and  then  quickly  determining  which  model  best  represents  an  unknown 
item,  whose  corresponding  features  are  sifted  through  the  hash  table.  NYU  has  evaluated  a 
number  of  computer  architectures,  including  a  Connection  Machine  for  large  scale  hashing 
implementations.* 

The  overall  objective  of  this  STTR  is  not  just  multidimensional  pattern  recognition,  but 
rather  maximum  extraction  of  information  from  multiple  sources,  which  may  be  dissimilar  and 
perhaps  not  even  imaging.  Hashing  directly  supports  such  fusion,  since  multiple  types  of 
features  can  be  the  basis  for  an  nD  hash  table.  In  fact,  features  do  not  have  to  have  the  same 
dimensionality,  the  formulation  for  which  has  been  developed  at  NYU.^ 


’  Y.  Lamdan  and  H.J.  Wolfson,  "Geometric  Hashing:  A  General  and  Efficient  Model-Based  Recognition  Scheme" 
Proc.  2nd  International  Conference  on  Computer  Vision  (ICCV).  pp.  238-249,  December  1988. 

^  R.  Hummel  and  H.  Wolfson,  "Affine  Invariant  Matching,"  DARPA  Image  Understanding  (lU)  Workshop,  April 
1988. 

^  A.  AkermafT  III,  R.  Patton,  et  al,  "Multisensor  Target  Acquisition/Target  Recognition  Using  Genetic  Algorithms 
and  Geometric  Hashing,"  Proc  4th  Automatic  Target  Recognizer  lATR)  Science  and  Technology  Symposia. 
ATRWG  PR-44-001,  Vol.  I,  pp.  61-90,  March  1995. 

A.  Akerman  III,  R.  Patton,  W.  Delashmit,  and  R.  Hummel,  "Target  Identification  Using  Geometric  Hashing  and 
FLIR/LADAR  Fusion,"  ARPA  lU  Workshop.  February  1996. 

^  A.  Califano,  "Multidimensional  Indexing  for  Recognizing  Visual  Shapes,"  IEEE  Trans  on  Pattern  Analysis  and 
Machine  Intelligence.  16(4),  1994,  pp.  373-392. 

^  I.Rigoustos  and  R.  Hummel,  "Several  Results  on  Affine  Invariant  Geometric  Hashing"  Proc  8th  Israel.  Conference 
on  Artificial  Intelligence  (AD  and  Computer  Vision  ('ey).  Tel  Avid,  December  1991. 

’  E.  Kishon  and  H.  Wolfson,  "3D  Curve  Matching,  Proc  of  AAAI  Workshop  on  Spatial  Reasoning  and  Multisensor 
Fusion,  pp.  250-261,  October  1987. 

*  0.  Bourden  and  G.  Medioni,  "Object  Recognition  Using  Geometric  Hashing  on  the  Connection  Machine,"  Proc 
International  Conference  on  Computer  Vision  (ICCVT  1990. 

’  D.  Geiger,  R.  Hummel,  et  al,  "The  Feature  Transform  for  ATR  Image  Decomposition,"  SPIE  Aerospace  Symposia, 
Orlando,  April  1995. 
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Figure  1.  Geometric  Hash  Point  Extraction  Algorithms  Applied  to  Ladar  Imagery 
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The  predominant  nature  of  all  the  aforementioned  programs  and  developments  has  been 
2D  hashing.  At  best,  extensions  to  higher  dimensionality  has  been  achieved  by  appending  labels 
to  the  2D  (x,y)  hash  points.  For  example,  our  personnel  were  significantly  involved  in  an 
ARPA/ARO  program  which  includes  Ladar  ATR  processing.  “  The  software,  which  runs  on  a 
SUN  SPARC  20  workstation,  has  been  modified  to  attach  Ladar  range  and  intensity  (and  up  to  8 
other  parameters)  to  the  azimuth  and  elevation  coordinates  representing  the  key  geometric 
components  of  the  object.  However,  only  the  geometric  components  are  hashed,  with  the 
unknown's  labels  then  simply  threshold  tested  against  the  corresponding  models  labels. 

The  thrust  of  this  STTR  development  has  been  to  devise  an  nth  order  hashing  schema, 
beginning  with  a  3D  implementation  for  Phase  I;  this  is  discussed  in  Section  2.  However,  our 
approach  is  not  limited  to  extending  the  hash  table  from  a  2D  to  3D  (or  higher  dimension) 
domain.  We  have  also  investigated  alternative  techniques  during  Phase  I,  including: 

•  Hashing  on  2D  plane  orthonormal  projections,  and  then  combining  the  results  using 
postclassifier  fusion  techniques 

•  Once  the  best  2D  match  is  made,  then  rotating  the  matched  plane  to  the  other 
orthogonal  planes  for  matching  refinement  by  performing  additional  hashing 

•  Combinations  of  the  above. 

Those  techniques  are  discussed  in  Section  3. 

Initially,  we  sought  to  port  the  ND  Hash  software  developed  by  NYU  into  the  Texas 
Instruments  Multimedia  Video  Processor  (TMS320C8X)  parallel  DSP  system.  This  task  was 
unsuccessfiil  due  to  the  large  amount  of  intra-memory  accesses  performed  by  the  NYU 
algorithm.  This  algorithm  makes  extensive  use  of  referenced  data  structures  to  represent  the  hash 
database  and  we  were  unable  to  port  these  constructs  using  the  C80  simulator.  In  essence,  the 
database  is  one  large  tree  of  pointer  references  where  the  coordinates  of  hash  points  and  their 
relationships  are  pointers  to  other  pointers.  The  database  is  traversed  and  search  is  accomplished 
by  following  the  references  down  the  tree  formed  by  the  structure  pointers.  This  approach  to  the 
programming  of  the  database  was  not  consistent  with  the  C80  architecture,  which  uses  localized 
data  spaces  and  was  unable  to  process  the  large  number  of  off-chip  references  into  main 
memory. 

However,  we  were  able  to  implement  a  2D  hashing  algorithm  onto  a  simulation  of  the 
C80,  as  discussed  in  Section  4.  This  provides  a  basis  for  hosting  the  iterative  2D  projection 
hashing  algorithms  described  in  Section  3. 

There  are  a  number  of  non-experimental  parallel  processing  systems  which  potentially 
meet  these  ND  Hash  STTR  criteria:  1)  the  parallel  processing  system  is  available  in  the 
commercial  marketplace;  2)  the  system  is  intended  to  be  general  purpose  in  the  sense  that  it  is 
programmable  for  multiple  applications;  and  3)  the  system  must  be  compact,  meaning  that  it  is 


Jyh-Jong  Liu,  A  Model-Based  3D  Object  Recognition  System  Using  Geometric  Hashing  with  Attributed  Features. 
NYU  PhD  Thesis,  October  1995. 

' '  A.  Akerman,  R.  Patton,  et  al,  "Geometric  Hashing  for  Three  Types  of  Sensor  Imagery,"  5th  ATR  Systems  and 
Technology  Symposium.  John  Hopkins  Uniyersity,  July  1996. 
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implementable  as  a  single-circuit  card  or  as  a  collection  of  small  cards  in  a  module.  The  parallel 
processing  systems  that  meet  these  criteria  are  listed  in  Table  1 . 


Table  1.  Parallel  Processor  Candidates  for  ND  Hashing 


1 

Description 

TMS320C80 

Texas  Instruments 

MIMD  Digital  Signal  Processor  (DSP) 

PAL- 1/2 

Lockheed  Martin 

Geometric  Arithmetic  Parallel  Processor 
(GAPP) 

MaxPCI 

Datacube,  Inc. 

MISD  (pipelined)  system 

HDS  SR4300 

Hitachi  Data  Systems 

Scalable  RISC  processors  in  configurations 
ranging  from  2  to  128  nodes. 

MM32k 

Current  Technology,  Inc. 

SIMD  architecture  containing  32768  Processing 
Elements  on  a  single  AT  board.  Each  PE  is  a 
complete  fixed  point  1  bit  ALU  with  it's  own 

5 12  bit  on-chip  local  memory. 

A236 

Oxford  Micro 

Parallel  DSP 

mPACT/3000 

Chromatics  Research 

SIMD  with  very  large  crossbar  switch  in 
multiport  RAM. 

The  processors  listed  in  Table  1  that  most  readily  supported  some  form  of  geometric 
hashing  were  determined  to  be  the  C80  and  the  Lockheed  Martin  Parallel  Array  Logic  (PAL- 
1/2).  As  already  mentioned,  the  C80  was  proven  feasible  during  Phase  I  for  implementation  of 
the  iterative  2D  projection  form  of  hashing.  Based  on  in-depth  discussions  with  the  Lockheed 
Martin  PAL  developers,  it  appears  that  the  PAL- 1/2  would  be  suitable  for  implementing  the 
NYU  Generalized  ND  Hashing  algorithms.  Hence,  Section  5  provides  additional  detail  on  that 
PAL  technology.  A  synergistic  attribute  of  this  approach  is  that  NYU  and  Lockheed  Martin  have 
already  worked  together  on  another  parallel  processing  application.'^  Both  the  C80  and  the  PAL 
processors  should  also  be  capable  of  hosting  the  attributed  label  form  of  2D  hashing. 

The  Datacube  MaxPCI  system  is  a  parallel  pipeline  architecture  and  would  not  be  as 
suitable  for  processing  as  either  the  C80  or  GAPP  because  of  the  intra-pixel  processing  required. 
The  Hitachi  HDS  SR4300  is  a  general  purpose  MIMD  architecture  of  coarse  scale  that  would  be 
difficult  to  implement  compactly.  Additionally,  software  tools  for  parallel  programming  of  the 
HDS  SR4jD0  are  unproven  and  not  at  the  level  of  sophistication  of  either  the  C80  or  the  GAPP. 
Current  Technologies  MM32k  system  is  a  SIMD  system  very  similar  in  architecture  to  the 
GAPP,  and  so  offering  no  gain  as  an  implementation  vehicle.  Likewise,  the  Oxford  Micro  A236 
and  the  Chromatics  Research  mPACT/3000  systems  are  chip-systems  like  the  C80.  The 
mP ACT/3  000  is  optimized  for  motion  estimation  and  would  not  support  hashing  to  the  same 
level  as  that  of  the  C80.  The  A236  is  similar  in  the  sense  of  the  parallel  DSP  aspects  of  the  C80, 
but  does  not  have  the  same  range  of  algorithm  flexibility  because  it  lacks  a  RISC-based 
executive  processor. 


'■  "The  Fulcrum  Project,"  NYU  Final  Status  Report,  July  31,  1996,  http://cs.nyu.edu/phci_students/raju/fulcrum/fulcrum.htmi. 
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We  have  recommended  that  all  three  forms  of  ND  Hashing  be  pursued  in  Phase  II  in  the 
following  manner: 

1)  2D  Hashing  with  Ten  Attributed  Labels  -  This  is  the  form  of  the  hashing  software 
successfully  demonstrated  in  the  recent  DARPA  unmanned  ground  vehicle  Demo  II 
program  for  both  FLIR  and  LADAR  automatic  target  recognition.*^  This  would  be 
the  baseline  algorithms  used  for  implementation  on  the  PAL- 1/2  processors. 

2)  Iterative  2D  Hashing  Projections  -  The  feasibility  of  this  algorithm  was  demonstrated 
during  Phase  I,  both  graphically  and  through  implementation  of  the  matching 
function  on  the  C80  processor. 

3)  Generalized  ND  Hashing  -  NYU  will  continue  the  development  of  these  Phase  I 
algorithms  with  respect  to  implementation  onto  a  PAL- 1/2  processor.  This  will  be 
accomplished  using  a  simulation  already  at  NYU  from  a  previous  collaborative  effort 
with  Lockheed  Martin.*^ 

It  is  important  to  note  that  the  Phase  II  implementation  encompasses  all  the  geometric 
hashing  processing  functions  shown  by  Figure  2,  and  not  just  the  matching  function. 
Accordingly,  both  the  C80  and  the  PAL-1/2  will  be  evaluated  with  respect  to  each  function.  The 
resulting  processor  hardware  may  well  be  a  hybrid  combination  of  both  the  C80  and  PAL-1/2. 
In  addition  to  perform  all  the  hashing  functions,  our  goals  for  that  hardware  implementation  are: 

•  Able  to  support  a  variety  of  sensor  types 

•  Size  less  than  1 .0  cubic  foot 

•  Cost  less  than  $20,000 

•  Capable  of  identifying  >10  targets  with  a  90%  correct  probability 

•  Operation  at  10-30  image  frames/second 


Figure  2.  Architecture  of  the  Geometric  Hashing  Processing  Functions 


R.  Patton  et  al,  "Target  Identification  Using  Geometric  Hashing  and  FLIR/LADAR  Fusion,"  in  Chapter  4,  "Target  Detection 
and  Recognition,"  Reconnaissance.  Surveillance,  and  Target  Acquisition  for  the  Unmanned  Ground  Vehicle.  Oscar  Firschein, 
ed.,  Morgan  Kaufman  Publishers,  Inc.,  in  press. 
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2.  GENERALIZED  ND  HASHING  SOFTWARE 


A  major  activity  during  Phase  I  was  the  rewriting  of  the  hashing  code  by  NYU  to  allow 
an  arbitrary  dimensionality.  Initially,  their  weighted  voting  form  of  hashing  was  implemented  in 
the  ND  structure.  This  is  described  further  in  Section  2.1.  Various  validation  tests  were 
performed  using  3D  Ladar  imagery,  which  is  further  described  in  Appendix  B.  The  validation 
test  results  were  extensive,  albeit  limited  to  translation  invariant  cases.  Section  2.2  summarizes 
those  results.  NYU  subsequently  enhanced  the  code  to  encompass  rotation  invariance  about  all 
three  axes.  A  source  code  listing  is  given  in  Appendix  A. 


2. 1  Summary  of  the  ND  Hashing  Algorithm 

When  using  geometric  hashing  for  object  recognition,  there  are  two  phases:  The  hash 
table  construction  (or  preprocessing)  phase,  and  the  recognition  (or  on-line)  phase.  First,  we 
discuss  the  construction  of  the  hash  table  that  will  enable  efficient  object  recognition  using  Ladar 
data. 


The  hash  table  encodes  information  about  the  models.  For  the  NYU  experiments,  there 
were  four  different  vehicle  types,  each  sampled  at  12  azimuthal  directions,  and  at  one  depression 
angle.  In  order  to  accomplish  the  translation  invariance,  we  use  the  notion  of  a  basis  feature.  In 
our  case,  the  features  are  3D  relative  locations  of  boundary  points  on  the  ladar  image  of  the 
model,  sampled  in  such  a  way  that  we  retain  only  those  points  whose  2D  projection  of  the 
boundary  exhibits  high  curvature  at  the  corresponding  image  point.  The  3D  coordinate  is 
computed  relative  to  one  of  the  extracted  3D  points,  which  is  the  basis  point.  (See  Appendix  B 
for  a  listing  of  those  hash  points). 

To  construct  the  hash  table,  we  do  the  following:  For  every  vehicle  type,  for  every  view 
direction,  for  every  possible  basis  point,  we  compute  the  collection  of  extracted  relative  3D 
feature  locations;  for  each  such  point,  we  construct  an  "entry"  and  include  pointers  to  the  entry  in 
bins  in  a  3D  hash  table.  We  place  a  pointer  to  the  entry  in  every  bin  that  is  "near"  the  3D 
location  of  the  feature. 

As  shown  by  Figure  3,  the  entry  contains  the  following:  The  3D  relative  location, 
knowledge  of  which  model  (type  and  view  direction)  and  which  basis  point  gave  rise  to  the 
entry,  and  information  necessary  to  compute  a  metric  that  measures  the  distance  from  the  feature 
location  to  potential  matching  test  points.  This  metric  is  based  on  the  predicted  statistical 
behavior  of  the  model  feature  point. 
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Figure  3.  Hash  Table  Construction  Methodology 

In  the  recognition  phase,  we  begin  with  an  observed  Ladar  image,  and  we  extract 
boundary  points  with  high  curvatures  at  the  2D  projections.  A  basis  point  is  chosen.  The 
extracted  features  are  computed  relative  to  the  basis  point.  For  each  such  extracted  feature,  we 
have  a  relative  3D  location,  which  "hashes"  to  a  single  bin  in  the  hash  table.  In  the  hash  bin, 
there  is  a  list  of  pointers  to  entries.  Each  such  entry  is  accessed  and  a  distance  between  the 
observed  relative  3D  location  and  the  entry's  relative  3D  location  is  computed.  The  value  is 
stored  in  a  "score"  field  associated  with  the  entry  by  applying  a  max  operator  to  the  existing 
score.  Initially,  all  such  fields  have  a  negative  weight  constituting  a  penalty  for  an  unmatched 
model  point.  The  process  is  shown  in  Figure  4. 


Figure  4.  Voting  Methodology  for  Determining  Candidate  Matches 
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Whenever  a  score  field  is  increased  significantly,  the  associated  model/basis  v^hich  gave 
rise  to  the  entry  is  "marked."  After  all  max-votes  are  applied  for  all  extracted  features,  then 
every  marked  model/basis  computes  a  score  by  summing  the  scores  of  the  entries  associated  with 
the  model/basis.  Note  that  there  are  many  possible  model/bases,  since  the  model  is  a  vehicle 
type  at  a  particular  view  angle,  and  the  basis  is  a  designated  feature  extracted  from  the  model. 
Finally,  the  top  few  model/basis  scores  are  tallied  and  reported.  These  are  candidate  matches. 

As  detailed  in  Appendix  C,  NYU  has  evolved  a  theory  to  optimize  and  validate  the 
scoring  function  that  is  applied  to  individual  matches  between  features  extracted  from  the  test 
scene  and  features  from  the  models.  The  formulas  are  based  on  a  Bayesian  computation  of  a  log- 
probability  of  the  match  hypothesis  relative  to  the  prior  probability,  and  also  on  an  assumption  of 
independence  of  the  individual  mismatches  of  the  features  conditioned  on  the  match  hypothesis. 

Using  Bayes'  formula,  the  log-probability  ratio  can  be  converted  into  a  log-likelihood 
ratio,  which  in  turn  can  be  seen  to  be  a  sum  of  log-likelihood  ratios,  of  the  from 
log(P(E  I  H)/P(E)),  where  E  is  the  "evidence"  consisting  of  the  proposed  matches,  and  H  is  the 
hypothesis,  i.e.,  the  model.  The  numerator  is  the  likelihood  of  a  particular  feature  value  given  its 
association  to  a  predicted  model  feature,  while  the  denominator  is  the  likelihood  of  the  same 
extracted  feature  in  the  absence  of  a  hypothesis  of  the  presence  of  a  model. 

For  the  ND  Hash  experiments,  we  assumed  that  the  predicted  model  features,  computed 
relative  to  a  basis  point,  will  be  distributed  according  to  a  Gaussian  distribution  in  3D  space,  with 
a  characteristic  covariance  matrix  that  can  be  specified  by  the  user.  Accordingly,  the  log 
likelihood  ratio  of  the  individual  summed  terms  that  comprise  the  score  for  a  matching 
hypothesis  are  each  given  by  a  log-ratio,  or  equivalently  a  difference  of  logs,  using  the  Gaussian 
distribution  for  the  matching  hypothesis,  and  a  background  clutter  density  statistic  for  the  a  priori 
likelihood. 

Finally,  if  the  resulting  score  becomes  too  negative,  then  we  can  assume  that  the 
extracted  feature  should  not  be  matched  to  the  predicted  feature,  and  we  invoke  a  cut-off  penalty 
for  the  unmatched  model  point.  Likewise,  if  the  score  is  too  positive,  then  we  use  a  clip  value  to 
ensure  that  no  single  match  dominates  the  score.  Figure  5  illustrates  this  Weighted  Voting 
formula  which  is  applied  to  the  observed  3D  point  on  the  unknown  test  object  and  the  3D  model 
points  stored  in  the  bins  of  the  hash  table. 
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Figure  5.  Weighted  Voting  Methodology 


2.2  Validation  Tests 

As  detailed  in  Appendix  B,  NYU  began  by  constructing  the  four  target  models  shown  in 
Figure  6:  the  HMMWV  configured  as  a  cargo  vehicle,  the  Ml  13  APC,  the  M3 5  truck  with  a 
canvas  cover  over  the  truck  bed,  and  the  M60  tank.  Using  BRLCAD  data,  NYU  generated 
synthetic  Ladar  data  for  each  model  at  every  angle  azimuth  sampled  at  30  degrees.  For  testing 
purposes,  a  few  models  are  generated  at  intermediate  (15  degree  angles)  as  well.  NYU  extracted 
points  of  high  curvature.  The  location  information  together  with  the  depth  value  became  the  3D 
feature  location. 


M3  5  M60  HMMWV-Cargo 


canvas 


Ml  13 


Figure  6.  BRLCAD  Models  Used  to  Validate  the  Generalized  ND  Hashing  Software 


A  variety  of  experiments  have  been  conducted  to  validate  the  software,  including  the 
following: 


a.  Using  one  of  the  models  as  a  test  target  always  produced  a  correct  match.  As  an 
example,  for  the  HMMWV  (Cargo)  model  at  30°  azimuth,  the  correct  vote  had  the 
highest  score  of  74,  whereas  all  other  matches  scored  30  or  less. 
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b.  Creating  a  new  test  target  by  adding  uniform  random  noise  to  one  of  the  models. 
With  ±  0.5  units  of  random  noise  added  to  each  hash  point  of  the  HMMWV  case  test 
model,  the  correct  match  was  again  made;  not  unexpectedly,  the  winning  votes  was 
somewhat  lower  at  a  vote  of  60.  As  also  shown  by  Figure  7,  similar  results  were 
obtained  for  the  Ml  13  targets. 


M11 3. 30  degrees,  with  noise 

Model,  angle,  basis  ' 
,0M113.3O,7  I 
■■M113,210,8  : 

iaM113,270,  8 
|□M113,30,8 
|■M113,210,9. 


HMMWV -Cargo,  30  degree,  with  noise 

)ut  of  1 19  without  noise 


Model,  Angle,  Basis 


HMMWV-Cargo,  30,  7 

■  HMMWV-Cargo,  30,  8 
□  M35-Canvas,  30,  9 

p  HMMWV-Cargo,  210,3 

■  M35-Canvas,  30,  10 


Figure  7.  Validation  Test  Using  Training  Models  with  Noise  Added 


c.  For  each  of  the  four  target  types  in  the  hashing  table  an  unknown  target  at  45° 
azimuth  was  tested  to  determine  if  it  would  be  matched  to  the  correct  type,  as  well  as  the 
nearest  model  orientation  (e.g.,  30°  or  60°  azimuth). 

(1)  Unknown  HMMWV  (Cargo)  -  Matched  to  the  correct  model,  with  both  the 
30°  and  60°  orientations  receiving  the  highest  vote  counts  of  33. 

(2)  Unknown  Ml  13  -  Incorrectly  matched  to  HMMWV  (Cargo)/270°  azimuth 
and  M60  tank/240°  azimuth. 

(3)  Unknown  M3 5  (Canvas)  -  Matched  to  the  correct  model  for  the  three  highest 
vote  counts:  27-60°,  25-120°,  and  24-30°. 

(4)  Unknown  M60  -  Incorrectly  matched  to  a  M3 5  (Canvas)/240°  azimuth. 

Although  two  of  the  tests  results(paragraph  c(2)  and  c(4))  are  disappointing,  they  are  not 
surprising  for  the  following  two  reasons. 

•  I-MATH's  experience  with  other  types  of  sensor  imagery  has  shown  that  good 
matching  performance  requires  the  model  represent  no  more  than  15°  in  angular 
excursion.  In  comparison,  the  NYU  models  are  separated  by  30°. 

•  I-MATH  prefers  that  each  target  model  have  the  same  quantity  of  hash  points,  and 
that  quantity  be  in  the  range  of  40-50.  As  summarized  in  Table  2  below,  the  NYU 
hash  table  is  much  more  sparse,  particularly  for  the  Ml  13  and  M60  which  had  the 
incorrect  matches. 
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Score 


Table  2.  Quantity  of  Associated  Hash  Points 


TEST 

HASH  TABLE 

45° 

O  1 
0 

i 

0 

O 

HMMWV 

27 

20 

23 

M113 

27 

14 

17 

M35 

32 

24 

28 

M60 

38 

17 

25 

d.  In  a  final  set  of  experiments,  two  new  unknown  targets  were  created,  both  being 
variants  of  existing  targets:  the  HMMWV  was  configured  as  a  troop  (rather  than  cargo) 
carrier,  and  the  M3  5  truck  had  its  canvas  removed.  These  two  variants  are  shown  in 
Figure  8,  which  also  shows  the  success  of  the  ND  Hashing  code  in  matching  the 
appropriate  model. 


M35  without  canvas,  30  degrees 


120 

100 

80 

60 

40 

20 

0 


i  0  M35-Canvas,  30,  9 
1 1  M35-Canvas,  30,10 
I  □  M35-(3anvas,  30,  8 
;  □  HMWW.Cargo.30.7 
I  BM35- Canvas,  30,  11 


HMMWV  Troop,  30  degrees 


m  HMWW-Cargo.  30.  7 
■  HMWW-Cargo.  30,  8 
I  □  M35-Canvas,  30, 9 
iDHMMWV-Cargo,  210,2 
:  ■  HMWW-Cargo,  60.  7 


Figure  8.  Validation  Test  Using  Variants  of  HMMWV  and  M35 
(HMMWV  configured  as  a  troop  carrier,  M35  without  canvas) 
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3.  2D  PROJECTION  ALGORITHMS 


3.1  Iterative  2D  Projection  Algorithms 


We  have  developed  an  alternative  to  the  existing  ND  Hash  approach  that  we  call  iterative 
2D  Projection.  This  method  makes  use  of  the  hash  points  derived  from  orthogonal  projections  of 
3D  targets  rather  than  all  of  the  3D  hash  points  used  in  the  ND  approach.  There  are 
computational  efficiencies  to  be  derived  from  this:  consider  the  ratio  between  the  number  of 
comparisons  performed  in  the  ND  case  and  those  performed  using  2D  projections.  This  ratio  is 
given  by: 


f{n,p)  = 


2  2 
C„Cp 


where  n  is  the  dimension  and  p  is  the  number  of  points  per  model.  When  the  ratio  is  less  than 
one,  it  takes  more  comparisons  in  the  ND  case  and  when  the  function  is  greater  than  one  the  2D 
Projection  method  requires  more  comparisons.  The  function  f(n,p)  is  a  measure  of  computational 
demand  and  will  be  one  for  n=2  (the  2D  Projection  case)  for  any  p.  As  n  increases,  the  value  of 
f(n,p)  increases  exponentially. 


The  2D  Projection  approach  represents  a  multiresolution  method  and  because  of  this  the 
computational  efficiency  can  be  exploited  in  a  parallel  architecture.  The  simplification  of  the 
hashing  algorithm  from  a  multi-dimensional  requirement  to  multiple  two  dimensional  problems 
will  facilitate  the  implementation  of  the  system,  particularly  in  the  C80.  Our  initial  results 
indicate  that  the  process  is  feasible. 


The  use  of  2D  Projections  as  a  replacement  for  ND  hashing  opens  up  two  important 
issues.  The  first  is  the  observation  that  specific  patterns  may  be  distinguishable  from  each  other 
only  in  one  particular  projection  plane,  as  shown  in  Figure  9. 
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Assume  that  the  unknown  is  the  prism  object  (2nd  column  in  the  figure)  with  each  of  its 
triangular  faces  represented  by  three  hash  points.  Using  a  basic  2D  Projection  hashing  scheme 
the  rectangular  model  could  develop  the  same  voting  weight  that  the  prism  model  would  yield, 
particularly  if  the  points  were  slightly  misaligned  in  the  hashing  bins  due  to  noise  in  the  source 
image.  We  propose  a  scheme  that  we  call  “2D  Iterative  Projection  Hashing”,  or  iterative 
projection  for  short.  This  involves  labeling  the  points  in  both  the  unknown  and  model  and 
monitoring  subsequent  pairings  that  occur  at  the  different  projections.  The  algorithm  starts  with 
a  2D  hashing  performed  on  the  first  projection.  Then,  the  pairs  of  points  that  match  are  used  as  a 
filter  for  the  next  projection.  Only  points  that  matched  previously  are  coimted  in  the  final  vote. 
The  point  matches  from  the  first  projection  that  point  match  the  second  projection  are  passed  to 
the  third  projection.  A  distance  toeshold  will  be  employed  that  allows  for  a  close-but-not-exact 
match  The  algorithm  then  outputs  the  number  of  pairs  that  matched  across  all  projections.  This 
approach  will  reduce  errors  due  to  false  pairings  and  will  also  present  a  search  advantage  as  only 
points  that  have  previously  matched  are  considered  in  the  next  iteration.  Figure  10  summarizes 
the  approach. 


Figure  10.  Iterative  Hashing-By-Projection 
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class  i 


Figure  12.  PLFA  Decision  Level  Fusion  Structure 

The  existing  PLFA  structure  permits  the  conclusions  of  any  number  of  hashing  classifiers 
(each  applied  to  an  independent  2D  projection)  to  be  combined  simply  and  reliably,  using 
statistics  that  describe  the  classifier  performance.  These  statistics  must  be  provided  n  the  form  of 
ROC  (receiver  operating  characteristic)  curves  which  are  graphs  of  the  probability  of  correct 
versus  incorrect  decisions.  The  fundamental  theory  that  describes  the  process  by  which  these 
statistics  can  be  fused  was  developed  by  Thomopoulos’®  and  involves  the  application  of  a 
Neyman-Pearson  (N-P)  test  using  likelihood  ratios  established  between  the  collaborating  ROC 
curves.  Thomopoulos  showed  how  a  N-P  test  could  be  applied  at  the  sensor  to  generate  a  binary 
decision  that  could  then  be  combined  with  other  binary  decisions  at  a  fusion  center. 


Thomopoulos,  S.,  et  al,  "Optimal  Decision  Fusion  in  Multiple  Sensor  Systems,"  IEEE  Trans.  AES-Q23.  No.  5,  pp.  644-653, 
September  1987. 
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4.  C-80  Implementation 


4. 1  Summary  of  the  Technical  Approach 

Part  of  the  Phase  I  effort  was  to  port  the  ND  Hash  software  developed  by  NYU  into  the 
Texas  Instruments  Multimedia  Video  Processor  (C-80)  parallel  DSP  system.  This  specific  task 
was  unsuccessful  due  to  the  large  amount  of  intra-memory  accesses  performed  by  the  NYU 
algorithm.  The  NYU  algorithm  makes  extensive  use  of  referenced  data  structures  to  represent  the 
hash  database  and  we  were  unable  to  port  these  constructs  using  the  C-80  simulator.  In  essence, 
the  database  is  one  large  tree  of  pointer  references  where  the  coordinates  of  hash  points  and  their 
relationships  are  pointers  to  other  pointers.  The  database  is  traversed  and  search  is  accomplished 
by  following  the  references  down  the  tree  formed  by  the  structure  pointers.  This  approach  to  the 
programming  of  the  database  was  not  consistent  with  the  C-80  architecture,  which  uses  localized 
data  spaces,  and  we  were  not  able  to  program  the  processor  to  access  the  large  number  of  off- 
chip  references  into  main  memory. 

Our  original  strategy  for  the  use  of  the  C-80  was  to  take  advantage  of  its  four  processor 
parallelism;  however,  these  processors  are  optimized  for  the  manipulation  of  pixel  data  that  is 
cached  in  memory  local  to  the  processors.  Any  references  to  data  in  the  main  memory  must  be 
accessed  through  the  master  processor  (An  architectural  discussion  of  the  C-80  is  given  in 
Section  4.2).  A  bottleneck  develops  when  there  are  extensive  pointer  references  taking  place 
between  the  four  processors  simultaneously.  Additionally,  the  simulator  was  unable  to  link  the 
NYU  code  because  all  memory  references  are  handled  as  a  cache  fault  and  internal  limits  on  this 
type  of  processing  were  reached.  Nevertheless,  we  developed  and  were  successful  in 
implementing  in  the  C-80  an  alternative  form  of  ND  Hashing,  2D  iterative  projections',  the 
details  of  that  algorithm  are  given  in  Section  3. 

The  2D  iterative  projection  approach  represents  a  multiresolution  method  and  because  of 
this  the  computational  efficiency  can  be  exploited  in  a  parallel  architecture.  The  simplification  of 
the  hashing  algorithm  from  a  multi-dimensional  requirement  to  multiple  two-dimensional 
problems  will  facilitate  the  implementation  of  the  system  in  the  C-80.  Our  results  indicate  that 
the  process  is  not  only  feasible  but  desirable.  Note  that  iterative  2D  projections  does  not  imply 
any  loss  of  n-dimensionality  as  the  space  can  be  easily  expanded  across  multiple  2D  spaces. 

An  issue  associated  with  2D  iterative  projection  is  that  of  the  multidimensional  data 
beyond  the  3D  spatial  projections  that  make  the  system  truly  “ND”.  The  ND  information  can  be 
treated  as  what  we  call  “attributed  labels”.  Attributed  labels  are  data  values  that  can  be 
associated  with  a  viewpoint  or  with  a  model  point.  In  other  words,  if  a  LADAR  intensity  value  is 
associated  with  a  model  point,  then  that  intensity  can  be  used  as  the  fourth  element  of 
comparison.  This  feature  is  then  hashed  in  the  same  way  and  provides  an  added  vote  to  the  final 
tally  for  an  unknown.  Additionally,  if  boresighted  FLIR  data  is  associated  with  a  point,  it  can 
provide  the  fifth  dimension  of  comparison.  Since  the  comparisons  are  done  independently 
(unlike  the  ND  case,  where  all  features  are  included  in  the  same  database),  any  a  priori 
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influences  to  the  fusion  process  that  are  desired  can  be  applied  external  to  the  database  at  the 
algorithm  level. 

Fusion  influencing  thresholds  are  global  to  a  feature  type.  For  example,  if  there  is 
intelligence  that  influences  the  detection  probabilities  of  a  sensor  system,  such  as  a  weather 
forecast,  the  interpretation  thresholds  can  be  adjusted  accordingly  using  the  iterative  projections 
approach.  Alternately,  if  any  match  enhancing  thresholds  are  stored  as  part  of  the  database  as  in 
the  ND  case,  then  this  will  increase  both  the  size  and  complexity  of  the  database  and  force  the 
search  algorithm  to  use  a  single  strategy  for  evaluation.  Any  changes  to  the  information  fusion 
process  will  have  to  occur  in  the  database,  or  will  necessitate  a  reconstruction  of  the  database  to 
match  the  new  thresholds. 


4.2  2D  Parallel  Hashing  in  the  C-80 

We  were  successful  in  implementing  a  2D  hashing  algorithm  in  the  C-80  that 
demonstrates  our  ability  to  produce  the  foundation  of  the  2D  iterative  projections  algorithm.  This 
was  accomplished  by  coding  the  hash  database  for  each  model  into  a  novel  data  structure  that  we 
call  the  Hash  Database  Image,  *or  HDI.  The  HDI  contains  a  compact  representation  of  a  hash 
table  that  is  produced  off-line.  Each  pixel  coordinate  in  the  HDI  represents  a  key  into  the  2D 
hash  table,  while  each  pixel  contains  a  coding  of  the  model  and  basis  pair  associated  with  that 
coordinate.  Each  model  translation  and  rotation  are  coded. 

An  HDI  contains  an  entire  projection  database  for  a  model  and  can  be  loaded  and 
searched  from  a  single  Parallel  Processor(PP).  The  advantage  of  processing  the  hash  table  into  an 
image  is  that  the  C-80  is  optimized  for  operations  that  involve  pixel  data  and  so  the  full  power  of 
the  architecture  is  exploited.  The  search  takes  place  in  parallel  over  multiple  classes,  or  multiple 
projections  simultaneously.  This  strategy  has  a  final  bonus  in  that  it  is  consistent  with  the 
iterative  projections  approach,  which  is  computationally  advantageous  over  the  Generalized  ND 
Hashing  methodology.  In  the  2D  hash  case  as  implemented  in  the  C-80,  the  Master 
Processor(MP)  receives  all  votes  produced  by  the  Parallel  Processors  and  tallies  those  votes  to 
determine  the  target  class  of  the  unknown.  (Each  PP  processes  a  single  target  class  database).  For 
the  2D  iterative  projection,  each  PP  will  process  the  first  projection  database  of  a  different  target 
class  so  that  four  classes  can  be  examined  simultaneously,  as  in  the  existing  2D  hash  case.  After 
the  initial  projection,  results  will  be  passed  to  the  next  search,  which  will  involve  searching  the 
filtered  points  (those  points  that  matched)  through  the  next  projection.  Points  that  pass  this 
search  will  be  searched  in  the  final  projection  or  passed  through  the  attributed  label  datasets. 
Matches  will  then  be  sorted  and  formatted  by  the  MP  for  final  output. 

As  shown  by  Figure  13,  the  TMS320C80  Multimedia  Video  Processor  (C-80)  is  a  fully 
integrated  parallel  processor  that  is  comprised  of  a  32-bit  RISC  Master  Processor  (MP)  and  four 
32-bit  Advanced  Digital  Signal  Processors  (ADSPs)  on  a  single  chip.  The  processor  is  driven  by 
a  50  MHz  clock  that  yields  a  20  nsec  basic  instruction  rate.  Performance  has  been  measured  at 
100  MFLOPS,  250  MIPS,  and  2  BOPS  overall.  The  32-bit  floating-point  RISC  MP  is  rated  at 
100  MFLOPS  and  50  MIPS  while  the  four  32-bit  integer  ADSPs  are  rated  at  50  MIPS  each. 
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The  C-80  has  50  Kbytes  of  on-chip  RAM,  in  25  2-Kbyte  blocks  that  are  shared  among  all 
processors  via  a  high-speed  crossbar  switch.  The  crossbar  s'witch  supports  15  concurrent 
accesses  per  cycle  of  8,  16,  32,  and  64-bit  data.  The  C-80  is  a  fully  programmable  MIMD 
architecture.  The  system  can  access  4  Gbytes  of  off-chip  RAM  in  the  same  data  widths  as  the 
internal  addressing.  The  MP  has  a  4-Kbyte  RISC  instruction  cache  and  a  4-Kbyte  data  cache. 
Each  PP  has  a  2-Kbyte  instruction  cache. 


Four  advanced  DSPs.  These  ADSPs  are 
advanced,  32-bit  integer  units. 


Master  processor  (MP).  The  MP  is  a  32-bit  RISC  processor  with 
EEEE-754  floating-point  unit  (FPU)  hardware. 


On-chip  RAM.  50K  bytes  of  single-cycle 
memory  is  divided  into  25  2K-byte  RAMs 


Crossbar.  On-chip  processors  use  crossbar 
switching  to  access  on-chip  RAM. 


Video  controller  (VC). 

The  VC  includes  dual 
frame  timers  that  provide 
simultaneous  image 
capture  and  display. 

Test  access  port  (TAP), 
Built-in  internal  emulation 
and  boundary  scan  paths 
are  accessed  through  the 
IEEE-1149. 


Transfer  controller  (TC). 
The  TC  is  used  for  cache 
servicing  and  transferring 
blocks  of  data  between 
external  memory  and 
internal  SRAM;  external 
and  internal  memory 
accesses  use  a  64-bit  port. 


Figure  13.  TMS320C80  (MVP)  Architecture 


The  system  can  transfer  64-bit  words  at  a  rate  of  400  Mbytes/sec  via  the  on-chip  transfer 
controller  (TC).  The  system  also  heis  two  video  memory  frame  controllers  on-chip  to  facilitate 
image  I/O.  The  TC  is  a  combined  DMA  machine  and  memory  interface  that  intelligently  queues, 
prioritizes,  and  services  the  data  requests  and  cache  misses  of  the  MP  and  the  PPs.  The  transfer 
controller  interfaces  directly  with  the  on-chip  SRAMs.  Through  the  TC,  all  of  the  processors  can 
access  the  system  external  to  the  chip.  In  addition,  data-cache  or  instruction-cache  misses  are 
automatically  handled  by  the  TC.  Data  transfers  are  specifically  requested  by  the  PPs  or  the  MP 
in  the  form  of  linked-list  packet  transfers,  which  are  handled  by  the  TC.  These  requests  allow 
multidimensional  blocks  of  information  to  be  transferred  between  a  source  and  destination,  either 
of  which  can  be  on-chip  or  off-chip. 

The  parallel-processing  advanced  DSP  (PP)  data  unit  has  two  data  paths,  where  each  path 
has  its  own  set  of  hardware  that  functions  independently  of  the  other.  The  ALU  data  path 
includes  a  barrel  rotator,  mask  generator,  1-bit  to  n-bit  expander,  and  a  3 -input  ALU  that  can 
combine  the  mask  or  expander  output  with  register  data  to  create  over  2,000  different  processing 
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options.  The  3-input  ALU  can  perform  512  logical  and/or  mixed  logical  and  arithmetic 
operations  that  support  masking  or  merging  and  addition/subtraction  in  a  single  pass. 

All  of  these  features  make  the  C-80  an  excellent  vehicle  for  the  processing  of  the  2D 
Iterative  Projections  algorithm.  The  C-80  processing  of  the  Hash  Data  Images  is  not  unlike 
discrete  correlation  and  template  matching,  which  the  C-80  has  been  optimized  to  perform.  The 
added  capability  of  the  Master  Processor  to  the  system  allows  for  non-parallel  processing  such  as 
vote  tallies  and  application  of  nonlinear  discriminants  to  take  place  independent  of  the  parallel 
processing  tasks. 

We  coded  the  2D  Iterative  Projection  hash  algorithm  in  C  code  on  a  Sun  computer  that 
processes  target  points  with  selection  of  unique  basis  pairs  and  subsequent  translation  and 
rotation  to  the  origin.  The  coordinate  points  are  then  stored  as  a  table  where  the  first  column 
represents  a  coordinate  in  hash  space  and  the  second  column  the  basis  pairs  associated  with  that 
coordinate.  The  table  is  then  processed  into  a  hash  database  image  as  discussed  below. 


4.3  Algorithm  Implementation  and  Test  Results 

The  system  we  designed  to  process  2D  hashing  in  the  C-80  is  illustrated  in  Figure  14. 
The  process  begins  with  the  formatting  of  a  hash  database  into  a  database  image.  The  hash 
databases,  one  per  target  class,  are  processed  off-line  using  a  known  model  set.  Each  entry  in  the 
database  constitutes  a  coordinate  pair  with  a  set  of  matching  pose  points.  These  pose  points  are 
then  encoded  in  binary  and  formed  into  a  database  ‘image’.  Each  pixel  in  the  image  is  coded 
with  the  model  poses  where  the  pixel  coordinates  are  the  same  as  those  of  the  hash  database.  For 
our  testing  we  coded  four  target  classes,  the  M60,  Ml  13,  HMMWV  and  BMP  using  an  X-Y 
projection  extraction  (discarding  depth,  or  Z,  information)  from  the  3D  Hash  Point  data  sets 
given  in  Appendix  B. 

Any  number  of  C-80  systems  may  be  combined  to  increase  the  number  of  target  classes 
or  features  that  are  processed  in  parallel.  Iterative  projection  is  ‘scaleable’  in  the  sense  that  the 
projections  are  multiple  2-D  independent  databases.  Each  projection  can  be  coded  and  searched 
in  parallel  and  attributed  label  feature  sets  likewise  can  be  coded  and  searched.  Additionally, 
algorithms  to  improve  recognition  can  be  implemented  directly  on  the  PPs,  while  the  iterative 
process  can  be  orchestrated  by  the  MP. 

The  model  sets  that  we  used  consisted  of  12  poses  (30°  rotations)  for  each  class  that 
generated  hash  databases  of  roughly  300Kbytes  each.  These  were  processed  into  database 
images  as  described  above.  We  presented  an  unknown  M60  to  the  system  with  the  following 
result: 
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C-80 


decision 


Figure  14.  C-80  (TI  MVP)  Processing  of  Hash  Database  Images 


Table  3.  C80  2D  Hashing  Results  for  an  Unknown  M60  Target 


Processor/Class 

Pose 

Vote 

HMMWV 

60 

7 

M3  5 

120 

12 

M60 

270 

27 

M113 

90 

6 

These  results  are  significant  in  that  the  hashing  occurred  in  parallel  on  a  compact  system 
capable  of  being  fielded  in  military  applications.  Another  point  of  significance  is  that  the  hashing 
database  was  processed  as  a  novel  database  image.  Images  of  target  classes  can  be  stored  into 
Read-Only  Memories  (ROM)  in  multiple  C-80  systems  so  that  large  numbers  of  classes  and 
poses  can  be  searched  in  parallel.  As  new  target  classes  are  developed  or  databases  are  improved 
the  system  can  be  easily  field  upgraded. 
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5.  GAPP/PAL  IMPLEMENTATION 


The  I-MATH/NYU  team  has  the  overall  objective  of  implementing  geometric  hashing 
algorithms  onto  a  commercial  off  the  shelf  (COTS)  image  processor  optimum  for  a  vvide  variety 
of  military  and  commercial  applications.  These  algorithms  will  provide  real-time  execution  of 
automatic  target  recognizer  and  information  fusion  applications  which  use  high  dimensionality 
information.  The  Lockheed  Martin  GAPP/PAL*  and  the  TI  C80  processors  have  been  chosen 
because  both  have  proven  parallel  image  processing  architectures,  which  is  the  predominant  ND 
hashing  data  format.  As  shown  by  Figure  15,  the  GAPP  is  best  at  SIMD  type  problems, 
primarily  inter-pixel  tasks.  As  previously  discussed  in  Section  4.2,  the  C80  is  best  suited  to  intra¬ 
pixel  and  databasing  tasks.  Each  processor  is  capable  of  running  all  of  the  anticipated 
algorithms;  however,  the  hybrid  combination  of  the  two  is  most  likely  to  produce  the  most 
efficient  real-time  data  processing. 


ALU 


20  SIMD 
Arcilitecture 


A 


T 

S 


•  Massively  parallel  array  of  processors  (scalable  to  overSA.OOO  processors) 


•  Rne-grained,  two-dimensional  SIMD  array  of  processors  directly  mirrors  the  image  data  structure  for 
maximum  efficiency  in  data  handling 


•  1-t3it  serial  processors  extend  the  RISC  concept  to  the  limit  for  maximum  hardware  efficiency  with  algorithm 
operations  from  1 -bit  to  floating  point 


Figure  15.  2D  SIMD  Architecture's  Match  of  Image  Data  Structure 


Table  4  shows  the  historical  progression  of  GAPP  chips.  The  current  GAPP  chip  has 
evolved  as  silicon  technology  has  evolved,  but  the  architecture  has  remained  consistent,  the 
SIMD  organization  remains  the  preferred,  and  demonstrably  the  best  image  processor.  In 
addition  to  bit-level  and  multi-bit  image  processing,  GAPP  chips  efficiently  perform  floating 
point  operations  even  though  they  are  composed  of  simple  1-bit,  bit-serial  processing  cells. 


*  Lockheed  Martin  has  developed  a  family  of  Geometric  Arithmetic  Parallel  Processors  (GAPP)  which  are  SIMD  devices  using 
Parallel  Algebraic  Logic  (PAL).  The  current  commercially  available  system  is  a  GAPP-4,  which  is  part  of  the  PAL-1  family. 
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Table  4.  CISP  Architecture  is  based  on  mature  GAPP  Chips 
(geometric  arithmetic  parallel  processor) 


Chip  Parameter 

GAPP  I 
(1983) 

GAPP  II 
(1984) 

GAPPm 

(1990) 

GAPP  IV 
(1993) 

Processing  array  elements 

3x6 

6x  12 

8x16 

16x  12 

Clock  Rate 

5MHz 

15  MHz 

25  MHz 

40  MHz 

Memory/Element 

128  bits 

128  bits 

128  bits 

192  bits 

New  features 

1 

1 

1 

1 

1 

Global  OR, 
fork 

Segmented  RAM 
enhanced  ALU 

3-port  RAM,  pipelining, 
enhanced  ALU,  JTAG 

Foundry 

NCR 

NCR 

■SiSHaSui 

LSI  Logic 

Number  of  I/O  pins 

68 

76 

128 

180 

Technology  (CMOS) 

Sqm 

Power 

0.8W 

0.6W 

0.85W 

l.iw 

23  MOPS 

270  MOPS 

914  MOPS 

2560  MOPS 

8-bit  image  ops/IC 

4  MOPS 

43  MOPS 

178  MOPS 

768  MOPS 

Floating  point  ops/IC 

0.4  MFLOPS 

1  MFLOPS 

4  MFLOPS 

19  MFLOPS 

The  PAL  I  architecture  is  based  on  the  fourth  GAPP  generation  of  fine-grained, 
massively  parallel,  two-dimensional  grid  processors  developed  by  Lockheed  Martin.  The  PAL  I 
architecture  may  be  configured  for  either  embedded  or  workstation  applications,  although  the 
initial  PAL  emphasis  is  on  the  commercial  workstation  accelerator  configuration.  The 
workstation  configuration  is  useful  as  an  inexpensive  host  for  exploring  new  algorithm  ideas  and 
rapidly  developing  prototype  demonstrations  for  new  applications  and  customers.  The  6uVME 
board  format  has  been  selected  for  the  PAL  I  workstation  because  of  its  status  as  the 
predominant  commercial  packaging  standard.  The  PAL  I  workstation  speeds  the  execution  of 
compute  intensive  image  processing  algorithms  by  several  hundred  times  over  the  standard 
SPARC  20  host,  thereby  greatly  accelerating  the  algorithm  concept  development  and  evaluation 
process.  The  PAL  workstation  development  environment  is  supported  with  a  complete  set  of 
state-of-the-art  algorithm  and  software  development  tools,  including  Image  Algebra,  Khoros, 
Ada,  and  C++. 

The  PAL  I  architecture  has  been  laid  out  on  SEM-E  and  other  military  custom  packaging 
formats  in  addition  to  the  commercial  6uVME  board.  The  PAL  I  architecture  can  be  scaled 
directly,  simply  by  adding  or  subtracting  PAL  array  boards.  Each  PAL  I  array  board  contains 
over  4000  processing  elements  organized  in  a  64x72  grid,  and  throughput  support  is  linearly 
scaleable  between  1-  and  16-board  configurations.  Throughput  also  scales  depending  on  the 
precision  of  operation  required  at  each  step  of  the  algorithm  suite.  A  typical  commercial 
workstation  configuration  consists  of  two  array  boards  interconnected  as  a  128x72  grid  and  the 
controller/Sun  interface  board  and  provides  more  than  40  billion  operations  per  second  algorithm 
throughput  support.  The  interface  between  the  PAL  accelerator  and  Sun  workstation  consists  of 
a  16-bit  parallel  bi-directional  port  connected  to  the  Sun's  S-Bus  with  a  commercially  available 
interface  board.  This  interface  provides  a  28  MB/s  burst  transfer  rate  interface  that  is  adequate 
for  video  rate  image  transfers  from  Sun  memory.  The  embedded  PAL  I  configuration,  based  on 
6u  VME  boards,  uses  a  different  interface  and  control  board  capable  of  multisensor  and  higher 
data  rate  I/O  operation  (4  asynchronous  video  streams  allowing  a  total  of  50  million  16-bit  pixels 
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per  second).  The  embedded  I/O-controller  board  also  contains  two  C44  processors  in  order  to 
support  stand-alone  system  operation. 

The  next-generation  PAL  II  architecture  has  begun  the  detailed  chip  design  phase  in  a 
contract  with  the  LSI  Logic  foundry  that  will  utilize  their  latest  0.35|am  GIO  process.  The  PAL 
II  design  will  further  exploit  the  unique  characteristics  and  support  the  unique  needs  of  image 
processing  applications.  Two  major  goals  of  the  PAL  II  development  include  a  further  stretching 
of  the  scalability  limits,  both  on  the  high  and  low  ends,  and  a  streamlining  of  the  interfaceability 
of  PAL  II  chips.  Table  5  depicts  the  performance  and  scalability  goals  of  the  PAL  II 
architecture.  PAL  II  will  be  scaleable  from  a  single  32x32  array  chip  to  a  full  512x512  array, 
thus  providing  a  range  of  more  than  250x  in  terms  of  throughput  (i.e.,  from  10  GOPS  to  over  2.5 
TOPS)  performance.  In  its  minimum  configuration,  a  PAL  II  processor  providing  over  10  GOPS 
throughput  support,  over  30  GB/s  computational  memory  bandwidth,  and  over  640  MB/s  of  I/O 
bandwidth  is  expected  to  cost  less  than  $1000.  On  the  other  end  of  scalability,  a  512x512 
configuration  will  provide  over  2.6  TOPS  of  throughput,  over  7  TB/s  of  computational  memory 
bandwidth,  and  over  5  GB/s  of  I/O  bandwidth. 


Table  5.  PAL  II  Performance  Objectives 


] 

PAL  n  Array  Size 

128x128 

256x256 

512x512 

Number  of  boards 

1 

4 

16 

Board  area 

25  sq  in 

100  sq  in 

400  sq  in 

Volume 

(assumes  1/2"  pitch) 

12.5  cu  in 

50  cu  in 

200  cu  in 

Weight 

4  oz 

1  lb 

41b 

Power 

35  watts 

140  watts 

560  watts 

System  Cost 
(Qty  5000  boards) 

$4K 

$16K 

$64K 

Typical  application 

Expendable 

Munitions 

Fire  Control 
Systems 

Supercomputer 

Workstation 

Max  external  I/O  BW 

1.28  GB/s 

2.56  GB/s 

5.12  GB/s 

Throughput: 

1-bit  edge  ops 

8-bit  image  ops 

32-bit  floating  ops 

1311  GOPS 
164  GOPS 

1.8  GOPS 

5243  GOPS 
655  GOPS 

7.1  GOPS 

20.972  GOPS 
2621  GOPS 
28.6  GOPS 

Array  Computational 

Memory  I/O  bandwidth 

492  GB/s 

1966  GB/s 

7864  GB/s 

Price-performance 
(8-bit  "image"  operations 

$0.024/MOPS 

$24/GOPS 

$0.024/MOP 

$24/GOP 

$0.024/MOP 

$24/GOP 
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APPENDIX  A. 

Generalized  ND  Hash  Code 


ND-Hash  Directory  Structure 


ndhash 

doc 

src 


targets 


-  Documentation  files, 

-  Source  (.h,  .c)  files,  makefile, 

.0  files,  executable  "ndhash". 

-  Directory  "out"  -  has  results  files  *.out, 
summary  of  results  file  "results.txt". 

-  Model  and  test  target  features  file  "targets.txt". 


How  to  Run  ND-Hash 


(1)  cd  ndhash/src 

(2)  ndhash  .. /targets/targets .  txt  hiim_cargo  0  30  7  14  18 

(This  command  runs  ndhash,  reading  the  model  and  test  target 
feature  points  from  the  file  .. /targets/targets . txt,  using 
target (type=hum_cargo,  poseX=0,  poseZ=30)  as  the  test  target,  and 
using  feature  point  triple  (7,14,18)  of  the  test  target  as  the  test 
target's  basis.  Of  course,  any  target  in  the  target  features  file  (in 
this  case  .. /targets/targets .txt)  can  be  used  as  the  test  target.) 

(ndhash  takes  an  optional  last  argument  that  causes  random  uniform 
noise  to  be  added  to  each  coordinate  of  the  test  target's  feature 
points.  This  optional  last  argument  defaults  to  0  (e.g.,  in  the  above 
example) . 

For  example: 

ndhash  ., /targets/targets . txt  hum_cargo  0  30  7  14  18  10 

runs  ndhash  exactly  as  in  the  above  example,  but  -10.. 10  units  of 
random  uniform  noise  is  added  to  each  coordinate  of  the  test  target's 
feature  points.) 

(ndhash  prints  out  the  results  of  its  computations,  so  you  may 
want  to  redirect  its  output  to  a  file;  e.g.: 

ndhash  .. /targets/targets . txt  hum_cargo  0  30  7  14  18  > 
hum_cargo .0,30. out 

The  top  30  model,  basis  pairs  that  best  match  the  test  target  are 
printed  out  at  the  end  in  sorted  order.) 
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m 

M  makefile  for  ndhash 

m 


COMPILER=gcc 

all: 

ndhash: 
recog.o  -Im 
utils.o: 

matrix.o: 

hashtbl.o: 

recog.o: 

clean: 


ndhash 

utils.o  matrix.o  hashtbl.o  recog.o 

$(COMPILER)  -0  ndhash  utils.o  matrix.o  hashtbl.o 

utils.h  utils.c 


$(COMPILER)  -c  utils.c 

matrix.h  matrix.c  utils.h 

$(COMPILER)  -c  matrix.c 

hashtbl.h  hashtbl.c  utils.h  matrix.h 

$(COMPE.ER)  -c  hashtbl.c 

recog.c  utils.h  matrix.h  hashtbl.h 

$(COMPILER)  -c  recog.c 


rm  -f  *.o 
rm  -f  ndhash 


/* 

utils.c 

*/ 

#include  "utils.h" 
int  _MsgVerbosity_  =  0; 

extern  void  Assert(boolean  b,  CharPtr  msg) 

{ 

if  (!b)  { 

printf("Assert():  Failure:  %s\n",  msg); 
exit(l); 

} 

} 

/* 

hashtbl.c 

*/ 
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#include  "utils.h" 

#include  "hashtbKh" 

#defme  _BackgroundDistr_  0.00001 

/* 

Point 

*1 

extern  Point  New_Point(int  dimension) 

{ 

Point  point  =  (Point)malloc(dimension*sizeof(DimensionType)); 
return  point; 

} 

extern  void  Destroy_Point(Point  point) 

{ 

free(point); 

} 

extern  void  Copy_Point(int  dimension,  Point  pi,  Point  p2) 

{ 

inti; 

for  (i  =  0;  i  <  dimension;  i++)  { 
p2[i]  =  pl[i]; 

} 

} 

extern  DimensionType  Get_Distance_Point_Point 
(int  dimension.  Point  pi.  Point  p2) 

{ 

DimensionType  d  =  0; 
int  i; 

for  (i  =  0;  i  <  dimension;  i++)  { 

DimensionType  tl ; 

tl  =pl[i]-p2[i]; 
d+=tl*tl; 

} 

d  =  sqrt(d); 
return  d; 

} 

extern  void  Add_Point_Point(int  dimension.  Point  pi.  Point  p2.  Point  p3) 

{ 

inti; 

for  (i  =  0;  i  <  dimension;  i-H-)  { 
p3[i]  =  pl[i]  +  p2[i]; 
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} 

} 

ejctem  void  Subtract_Point_Point(int  dimension,  Point  pi.  Point  p2.  Point  p3) 

{ 

inti; 

for  (i  =  0;  i  <  dimension;  i-H-)  { 
p3[i]  =  pl[i]-p2[i]; 

} 

} 


/* 

Basis 

*/ 

extern  Basis  New_Basis(int  dimension) 

{ 

Basis  basis  =  (Basis)malloc(dimension*sizeof(FeatureNum)); 
return  basis; 

} 

extern  void  Destroy_Basis(Basis  basis) 

{ 

free(basis); 

} 

extern  void  Copy_Basis(int  dimension.  Basis  bl.  Basis  b2) 

{ 

int  i; 

for  (i  =  0;  i  <  dimension;  i-H-)  { 
b2[i]  =  bl[i]; 

} 

} 

/* 

HashTableEntry 

*/ 

extern  HashTableEntryPtr  New_HashTableEntry() 

{ 

HashTableEntryPtr  ep  = 

(HashTableEntryPtr)malloc(sizeof(HashTableEntry)); 
return  ep; 

} 

extern  HashTableEntryPtr  New  Set  HashTableEntry 

( 

int  dimension, 
int  basisDimension, 

Point  point. 
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ModelNum  modelNum, 
Basis  basis, 
PDFPtrpdfPtr, 

StatsPtr  statsPtr, 
FeatureType  featureType 

) 

{ 


HashTableEntryPtr  ep; 

Point  entryPoint; 

ModelNum  entryModelNum; 

Basis  entryBasis; 

PDFPtr  entryPdfPtr; 

StatsPtr  entryStatsPtr; 

FeatureType  entryFeatureType; 

ep  =  New_HashTableEntry(); 

entryPoint  =  New_Point(dimension); 

Copy_Point(dimension,  point,  entryPoint); 

Set_HashT ableEntryPtr_Point(ep,  entryPoint); 

entryModelNum  =  modelNum; 

Set_HashTableEntryPtr_ModelNum(ep,  entryModelNum); 

entryBasis  =  New_Basis(basisDimension); 
Copy_Basis(basisDimension,  basis,  entryBasis); 
Set_HashTableEntryPtr_Basis(ep,  entryBasis); 

entryPdfPtr  =  pdfPtr; 

Set_HashTableEntryPtr_PdfPtr(ep,  entryPdfPtr); 
entryStatsPtr  =  statsPtr; 

Set_HashT ableEntryPtr_StatsPtr(ep,  entryStatsPtr); 
entryFeatureType  =  featureType; 

Set_HashTableEntryPtr_FeatureType(ep,  entryFeatureType); 
Set_HashTableEntryPtr_Vote(ep,  _VoteNull_); 
return  ep; 


} 

/* 

HashT  ableEntryNode 
*1 

extern  HashTableEntryNodePtr  New_HashTableEntryNode() 

{ 

HashTableEntryNodePtr  np  = 
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(HashTableEntiyNodePtr)malloc(sizeof(HashTableEntryNode)); 
Set_HashTableEntryNodePtr_EntiyPtr(np,  NULL); 

Set_HashT ableEntryNodePtr_Distance(np,  0); 

/* 

Set_HashT  ableEntryNodePtr_V  ote(np,  _V  oteNull_); 

*/ 

Set_HashTableEntryNodePtr_NextPtr(np,  NULL); 
return  np; 

} 

/♦ 

HashTableEntryList 

*/ 

extern  HashTableEntryListPtr  New_HashTableEntryList() 

{ 

HashTableEntryListPtr  Ip  = 

(HashTableEntryListPtr)malloc(sizeof(HashTableEntryList)); 
Set_HashTableEntryListPtr_FirstNodePtr(lp,  NULL); 
Set_HashTableEntryListPtr_LastNodePtr(lp,  NULL); 
Set_HashTableEntryListPtr_VotesHaveBeenComputed(lp,  FALSE); 
return  Ip; 

} 

extern  HashTableEntryListPtr  InsertHead_HashTableEntryListPtr_EntryPtr_Distance 
(HashTableEntryListPtr  Ip,  HashTableEntryPtr  ep,  DimensionType  distance) 

{ 

HashTableEntryNodePtr  np; 

HashTableEntryNodePtr  fhp; 

HashTableEntryNodePtr  Inp; 

np  =  NewHashTableEntryNodeO; 

Set_HashTableEntryNodePtr_EntryPtr(np,  ep); 
Set_HashTableEntryNodePtr_Distance(np,  distance); 
fhp  =  Get_HashTableEntryListPtr_FirstNodePtr(lp); 
Set_HashTableEntryNodePtr_NextPtr(np,  fnp); 
Set_HashTableEntryListPtr_FirstNodePtr(lp,  np); 

Inp  =  Get_HashTableEntiyListPtr_LastNodePtr(lp); 
if(lnp  =  NULL)  { 

Set_HashTableEntryListPtr_LastNodePtr(lp,  np); 

} 

return  Ip; 

} 


/* 

HashTable  Creation  and  Access  Functions 

*/ 

extern  HashTablePtrNew_HashTable 

( 
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int  dimension2, 

DimensionType  *diniensionMinVals2, 
DimensionType  *diraensionMaxVals2, 
int  *dimensionNumPartitions2 

) 

{ 

HashTablePtr  htp; 

DimensionType  *dimMinVals; 
DimensionType  *dimMaxVals; 
int  *dimNumPartitions; 

DimensionType  *dimPartitionSizes; 
int  numB; 
int  i; 

HashTableBucketPtr  ♦bps; 


htp  = 

(HashTablePtr)malloc(sizeof(HashTable)); 

Set_HashTablePtr_Dimension(htp,  dimension2); 
dimMinVals  = 

(DimensionType  *)malloc(dimension2*sizeof(DimensionType)); 
dimMaxVals  = 

(DimensionType  *)malloc(dimension2*sizeof(DimensionType)); 
dimNumPartitions  =  (int  *)malloc(dimension2*sizeof(int)); 
dimPartitionSizes  = 

(DimensionType  *)malloc(dimension2*sizeof(DimensionType)); 
Set_HashTablePtr_DimensionMinVals(htp,  dimMinVals); 
Set_HashTablePtr_DimensionMaxVals(htp,  dimMaxVals); 
Set_HashTabIePtr_DimensionNumPartitions(htp,  dimNumPartitions); 
Set_HashTabIePtr_DimensionPartitionSizes(htp,  dimPartitionSizes); 
numB  =  1 ; 

for  (i  =  0;  i  <  dimension2;  i++)  { 

DimensionType  dimensionMinV  als2I; 

DimensionType  dimensionMaxVals2I; 
int  dimensionNumPartitions2I; 

DimensionType  dimPartitionSizesI; 

dimensionMinVals2I  =  dimensionMinVals2[i]; 
dimensionMaxVals2I  =  dimensionMaxVals2[i]; 
Set_HashTablePtr_DimensionMinValI(htp,  i,  dimensionMinVals2I); 
Set_HashTablePtr_DimensionMaxValI(htp,  i,  dimensionMaxVals2I); 
dimensionNumPartitions2I  =  dimensionNumPartitions2[i]; 
Set_HashTablePtr_DimensionNumPartitionI(htp,  i,  dimensionNumPartitions2I); 
numB  *=  dimensionNumPartitions2I; 
dimPartitionSizesI  = 

(dimensionMaxVals2I  -  dimensionMinVals2I  +  1)  /  dimensionNumPartitions2I; 
Set_HashTablePtr_DimensionPartitionSizeI(htp,  i,  dimPartitionSizesI); 

} 

Set_HashTablePtr_NumBuckets(htp,  numB); 
bps  = 

(HashTableBucketPtr  *)malloc(numB*sizeof(HashTableBucketPtr)); 
Set_HashTablePtr_BucketPtrs(htp,  bps); 
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for  (i  =  0;  i  <  numB;  i-H-)  { 

HashTableEntryListPtr  Ip  =  New_HashTableEntryList(); 

HashTableBucketPtr  bp  =  Ip; 

Set_HashTablePtr_BucketPtrI(htp,  i,  bp); 

} 

return  htp; 

} 

extern  int  Get_HashTablePtr_Point_BucketNum_BucketMiclpoint 
(HashTablePtr  htp,  Point  point,  Point  bucketMidpoint) 

{ 

int  dimension; 
int  dimensionMinus  1 ; 
int  partitionNum; 
inti; 

dimension  =  Get_HashTablePtr_Dimension(htp); 
dimensionMinus  1  =  dimension- 1; 
partitionNum  =  0; 

for  (i  =  dimensionMinus  1;  i  >=  0;  i~)  { 
int  partitionNumI; 
int  prevDimsNumPartitions; 

partitionNumI  = 

(int) 

( 

(point[i]  -  Get_HashTablePtr_DimensionMinValI(htp,  i)) 

/  Get_HashTablePtr_DimensionPartitionSizeI(htp,  i) 

); 

/* 

printf("debugl:  10:  partitionNumI=%d\n",  partitionNumI);  fnush(stdout); 
printf("debugl;  15:  point[i]=%.2f,  %.2f,  %.2fm", 
point[i], 

Get_HashTabIePtr_DimensionMinV all(htp,  i), 
Get_HashTablePtr_DimensionPartitionSizeI(htp,  i) 

); 

fflush(stdout); 

*/ 

bucketMidpoint[i]  = 

Get_HashT ablePtr_DimensionMinV all(htp,  i) 

+  partitionNumI*Get_HashTablePtr_DimensionPartitionSizeI(htp,  i) 

+  Get_HashTablePtr_DimensionPartitionSizeI(htp,  i)/2; 

/* 

printfC'debugl:  20:  bucketMidpointI=%.2f^n",  bucketMidpoint[i]);  fflush(stdout); 
*! 

if  (i  =  dimensionMinus  1)  { 
prevDimsNumPartitions  =  1; 

}  else  { 

prevDimsNumPartitions  *= 

Get_HashT ablePtr_DimensionNumPartitionI(htp,  i+ 1 ); 

} 
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/* 

printfC'debugl:  30:  prevDimsNumPartitions=%d\n",  prevDirasNumPartitions);  fflush(stdout); 

*/ 

partitionNum  +=  partitionNuml^prevDimsNumPartitions; 

/* 

printfC'debugl:  40:  partitionNum=%d\n",  partitionNum);  fflush(stdout); 

*/ 

} 

return  partitionNum; 

} 

extern  void  InsertIntoHypercube_HashTablePtr_EntiyPtr 

( 

HashTablePtr  htp,  HashTableEntryPtr  ep, 

int  partitionRangeMinlndex,  int  partitionRangeMaxIndex, 

Point  entryPoint,  int  dimension,  Point  point.  Point  bucketMidpoint, 
int  loopDimensionNum 

) 

{ 

if  (loopDimensionNum  ==  dimension)  { 

/*  base  case  */ 

int  bucketNum; 

DimensionType  distance; 

HashTableBucketPtr  bp; 

HashXableEntryListPtr  Ip; 

bucketNum  = 

Get_HashTablePtr_Point_BucketNum_BucketMidpoint 
(htp,  point,  bucketMidpoint); 
distance  = 

Get_Distance_Point_Point(dimension,  point,  bucketMidpoint); 
bp  =  Get_HashTablePtr_BucketPtrI(htp,  bucketNum); 

Ip  =  (HashTableEntryListPtr)bp; 

lnsertHead_HashTableEntryListPtr_EntiyPtr_Distance(lp,  ep,  distance); 
if  (5  <=  _MsgVerbosity_)  { 

printf("Inserted  point=(%d,%d,%d),  modelNum=%d,  basis=(%d,%d,%d),  distance=%.2f  into  bucket 
%d\n", 

(int)Get_HashT  ableEntryPtr_Point(ep)[0] , 

(int)Get_HashTableEntryPtr_Point(ep)[  1  ] , 

(int)Get_HashTableEntryPtr_Point(ep)[2], 

Get_HashTableEntryPtr_ModelNum(ep), 

Get_HashTableEntryPtr_Basis(ep)[0], 

Get_HashTableEntryPtr_Basis(ep)[  1  ], 

Get_HashTableEntryPtr_Basis(ep)[2], 

distance, 

bucketNum 

); 

fflush(stdout); 

} 
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}  else  { 

/*  recursive  case  */ 


DimensionType  partitionSizeD; 
intp; 

partitionSizeD  = 

Get_HashTablePtr_DimensionPartitionSizeI(htp,  loopDimensionNum); 
for  (p  =  partitionRangeMinlndex;  p  <=  partitionRangeMaxIndex;  p-H-)  { 
point[loopDimensionNum]  =  entiyPoint[loopDimensionNum]  +  p*partitionSizeD; 
InsertIntoHypercube_HashTablePtr_EntryPtr 
( 

htp,  ep, 

partitionRangeMinlndex,  partitionRangeMaxIndex, 
entryPoint,  dimension,  point,  bucketMidpoint, 
loopDimensionNum+ 1 

); 

} 

} 

} 

extern  HashTablePtr  Insert_HashTablePtr_EntryPtr 

( 

HashTablePtr  htp,  HashTableEntryPtr  ep, 

int  partitionRangeMinlndex,  int  partitionRangeMaxIndex 

) 

{ 

Point  entryPoint  =  Get_HashTableEntryPtr_Point(ep); 
int  dimension  =  Get_HashTablePtr_Dimension(htp); 

Point  point  =  New_Point(dimension); 

Point  bucketMidpoint  =  New_Point(dimension); 

Copy_Point(dimension,  entryPoint,  point); 

InsertIntoHypercube_HashTablePtr_EntryPtr 

( 

htp,  ep, 

partitionRangeMinlndex,  partitionRangeMaxIndex, 
entryPoint,  dimension,  point,  bucketMidpoint, 

0 

); 


Destroy_Point(point); 

Destroy_Point(bucketMidpoint); 

return  htp; 

} 

extern  HashTableEntryListPtr  GetHashTableEntryListForEntry 
(HashTablePtr  htp,  HashTableEntryPtr  ep) 

{ 
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int  dimension  =  Get_HashTablePtr_Dimension(htp); 

Point  entryPoint  =  Get_HashTableEntryPtr_Point(ep); 

Point  entryBucketMidpoint  =  New_Point(dimension); 

int  entryBucketNum; 

DimensionType  entryDistance; 

HashTableBucketPtr  entryBp; 

HashTableEntryListPtr  entryLp; 

entryBucketNum  = 

Get_HashTablePtr_Point_BucketNum_BucketMidpoint 
(htp,  entryPoint,  entiyBucketMidpoint); 
entryDistance  = 

Get_Distance_Point_Point(dimension,  entryPoint,  entryBucketMidpoint); 
entryBp  =  Get_HashTablePfr_BucketPtrI(htp,  entryBucketNum); 
entryLp  =  (HashTableEntryListPtr)entryBp; 

Destroy_Point(entryBucketMidpoint); 

return  entryLp; 


} 

I* 

Compute  Vote  Functions 
*1 


extern  void  ComputeVotesInHashTableForEntry 

( 

HashTablePtr  htp,  HashTableEntryPtr  ep, 

int  partitionRangeMinlndex,  int  partitionRangeMaxIndex 


) 

{ 


Point  entryPoint  =  Get_HashTableEntryPtr_Point(ep); 
int  dimension  =  Get_HashTablePtr_Dimension(htp); 
Point  point  =  New_Point(dimension); 

Point  bucketMidpoint  =  New_Point(dimension); 

Copy_Point(dimension,  entryPoint,  point); 

ComputeVotesInHypercubeForEntry 

( 

htp,  ep, 

partitionRangeMinlndex,  partitionRangeMaxIndex, 
entryPoint,  dimension,  point,  bucketMidpoint, 

0 

); 
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Destroy_Point(point); 

Destroy_Point(bucketMidpoint); 


} 

extern  void  ComputeVotesInHypercubeForEntry 

( 

HashTablePtr  htp,  HashTableEntryPtr  ep, 

int  partitionRangeMinIndex,  int  partitionRangeMaxIndex, 

Point  entryPoint,  int  dimension,  Point  point.  Point  bucketMidpoint, 
int  loopDimensionNum 

) 

{ 

if  (loopDimensionNum  =  dimension)  { 

/*  base  case  */ 

int  bucketNum; 

HashTableBucketPtr  bp; 

HashTableEntryListPtr  Ip; 

bucketNum  = 

Get_HashTabIePtr_Point_BucketNum_BucketMidpoint 
(htp,  point,  bucketMidpoint); 
bp  =  Get_HashTablePtr_BucketPtrI(htp,  bucketNum); 

Ip  =  (HashTableEntryListPtr)bp; 

ComputeV  otesInHashT  ableEntryListForEntry 
(htp.  Ip,  ep); 

}  else  { 

/*  recursive  case  */ 

DimensionType  partitionSizeD; 
intp; 

partitionSizeD  = 

Get_HashTablePtr_DimensionPartitionSizeI(htp,  loopDimensionNum); 
for  (p  =  partitionRangeMinIndex;  p  <=  partitionRangeMaxIndex;  p-H-)  { 
point[loopDimensionNum]  =  entryPoint[loopDimensionNum]  +  p*partitionSizeD; 
ComputeV  otesInHypercubeForEntry 
( 

htp,  ep, 

partitionRangeMinIndex,  partitionRangeMaxIndex, 
entryPoint,  dimension,  point,  bucketMidpoint, 
loopDimensionN  um+ 1 

); 

} 

} 

} 

extern  void  ComputeVotesInHashTableEntryListForEntry 
(HashTablePtr  htp,  HashTableEntryListPtr  Ip,  HashTableEntryPtr  ep) 

{ 
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int  dimension  =  Get_HashTablePtr_Dimension(htp); 

Point  epPoint  =  Get_HashTableEntryPtr_Point(ep); 

HashTableEntryNodePtr  Inp  =  Get_HashTableEntryListPtr_FirstNodePtr(lp); 
if  (0  <=  _MsgVerbosity_)  { 

printf("Computing  votes  in  bin  for  test  entry;  point=(%.2f,%.2f,%.2f);  basis=(%d,%d,%d)  ...\n", 
Get_HashTableEntryPtr_Point(ep)[0], 

Get_HashTableEntryPtr_Point(ep)[  1  ], 

Get_HashT  ableEntryPtr_Point(ep)[2], 

Get_HashTableEntryPtr_Basis(ep)[0], 

Get_HashTableEntryPtr_Basis(ep)[  1  ], 

Get_HashTableEntryPtr_Basis(ep)[2] 

); 

fflush(stdout); 

} 


if  (Inp  !=NULL)  { 

Set_HashTableEntryListPtr_V otesHaveBeenComputed(lp,  TRUE); 

} 

while  (Inp  !=  NULL)  { 

HashTableEntryPtr  lep  =  Get_HashTableEntryNodePtr_EntryPtr(lnp); 
Point  lepPoint  =  Get_HashTabIeEntryPtr_Point(lep); 

PDFPtr  lepPdfPtr  =  Get_HashTableEntryPtr_PdfPtr(lep); 

Vote  oldVote  =  Get_HashTableEntryNodePtr_Vote(lnp); 

Vote  vote; 


I* 

vote  = 

Compute_DistanceVote_PredPoint_ExtrPoint 
(dimension,  lepPoint,  epPoint); 

*1 


vote  = 

Compute_Vote_PDFPtr_PredPoint_ExtrPoint_BackgroundDistrFuncPtr 
(lepPdfPtr,  lepPoint,  epPoint,  &Compute_BackgroundDistr); 

Assert(  (vote  ==  _VoteNull_)  ||  (vote  >=  _VoteMin_), 
"ComputeVotesInHashTableEntryListForEntryO:  non-null  vote  <  _VoteMin_"); 

if( 

(vote  !=  _VoteNull_)  /*  this  node's  new  vote  is  for  a  match  */ 

&& 
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(vote  >  oldVote)  /*  this  node's  new  vote  is  better  than  its  old  vote  */ 

){ 

Set_HashTableEntryNodePtr_Vote(lnp,  vote); 


if  (3  <=  _MsgVerbosity_)  { 

printf("Hash  table  entry:  point=(%d,%d,%d);  modelNum=%d;  basis=(%d,%d,%d);  vote=%.2f\n", 
(int)Get_HashTableEntryPtr_Point(lep)[0], 

(int)Get_HashTableEntryPtr_Point(Iep)[  1  ], 

(int)Get_HashTableEntryPtr_Point(Iep)[2], 

Get_HashTableEntryPtr_ModelNum(lep), 

Get_HashTableEntryPtr_Basis(lep)[0], 

Get_HashTableEntryPtr_BasisOep)[  1  ], 

Get_HashTabIeEntryPtr_Basis0ep)[2], 

vote 

); 

fflush(stdout); 

} 


} 

Inp  =  Get_HashTableEntryNodePtr_NextPtr(lnp); 


} 


} 

extern  Vote  Compute_DistanceVote_PredPoint_ExtrPoint 

( 

int  dimension,  Point  predictedPoint,  Point  extractedPoint 

) 

{ 

DimensionType  distance  = 

Get_Distance_Point_Point(dimension,  predictedPoint,  extractedPoint); 
Vote  vote  =  ceil(sqrt(l  0*1 0*10))  -  distance; 
return  vote; 


} 

extern  float  Compute_Log_PDFPtr_PredPoint_ExtrPoint 
(PDFPtr  pdfp.  Point  predictedPoint,  Point  extractedPoint) 

{ 

int  dimension  =  Get_PDFPtr_Dimension(pdfp); 

Point  mean  =  Get_PDFPtr_Mean(pdfp); 

Element  detCov  =  Get_PDFPtr_DetCov(pdfp); 

Matrix  invCov  =  Get_PDFPtr_InvCov(pdfp); 

float  term  1; 
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Point  extrMinusPred; 

Point  extrMinusPredMinusMean; 
float  term2; 

float  logpdf; 

terml  =  -0.5  *  Iog(  pow(2*PI,  dimension)  *  detCov ); 

/* 

printf("Compute_Log_...()  terml=%.2f\n",  terml);  fflush(stdout); 

*/ 

extrMinusPred  =  New_Point(dimension); 

Subtract_Point_Point 

(dimension,  extractedPoint,  predictedPoint,  extrMinusPred); 
extrMinusPredMinusMean  =  New_Point(dimension); 

Subtract_Point_Point 

(dimension,  extrMinusPred,  mean,  extrMinusPredMinusMean); 
if  (dimension  =  3)  { 

Point  product  1  =  New_Point(dimension); 

Element  product2; 

Mult_V  ector_Matrix 

(extrMinusPredMinusMean,  dimension,  invCov,  dimension,  dimension,  productl); 

/* 

printf("Compute_Log_...()  productl  =  (%.2f,%.2f,%.2f)\n",  productl[0],  productl[l],  productl[2]); 
fflush(stdout); 

*1 

Mult_Vector_Vector(productl,  extrMinusPredMinusMean,  dimension,  &product2); 

/* 

printf("Compute_Log_...()  product2=%.2f\n",  product2);  fflush(stdout); 

*1 

term2  =  -0.5  *  product2; 

/* 

printf("Compute_Log_...()  term2=%.2f\n",  term2);  fflush(stdout); 

*1 

}  else  { 

printf("Compute_Log_PDFPtr_PredPoint_ExtrPoint():  dimension  !=  3;  exiting.\n"); 
exit(l); 

} 

logpdf  =  terml  +term2; 
return  logpdf; 

} 

extern  float  Compute_BackgroundDistr(Point  extractedPoint) 

{ 

return  _BackgroundDistr_; 

} 

#defme  _InitialVoteMatchThreshoId_  -2 
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extern  Vote  Cotnpute_Vote_PDFPtr_PredPoint_ExtrPoint_BackgroundDistrFuncPtr 

( 

PDFPtr  pdfp,  Point  predictedPoint,  Point  extractedPoint, 

BackgroundDistrFuncPtr  backgroundDistrFuncPtr 

) 


{ 


float  term  1; 
float  term2; 
float  vote; 

/* 

printf("Compute_Vote_...()  model  entry:  point=(%.2f,%.2f,%.2f)\n", 
predictedPoint[0] , 
predictedPoint[  1  ] , 
predictedPoint[2] 

); 

fflush(stdout); 

*/ 

terml  = 

Compute_Log_PDFPtr_PredPoint_ExtrPoint 
(pdfp,  predictedPoint,  extractedPoint); 

/* 

printf("Compute_Vote_...()  terml=%.2f\n",  terml);  fflush(stdout); 

*/ 

term2  =  -log(  (*backgroundDistrFuncPtr)(extractedPoint) ); 

/* 

printf("Compute_Vote_...()  term2=%.2f\n",  term2);  fflush(stdout); 

*! 

vote  =  terml  +  term2; 

/* 

printf("Compute_Vote_...()  initial  vote=%.2f\n",  vote);  fflush(stdout); 
*1 

if  (vote  <  _InitialVoteMatchThreshold_)  { 

/*  model  entry  doesn't  match  test  entry  */ 
vote  =  _VoteNull_; 

}  else  { 

/*  model  entry  matches  test  entry  */ 

vote  +=  (_VoteMin_  -  _InitialVoteMatchThreshold_); 

} 

return  vote; 


} 

extern  void  PrintMsg(int  msgVerbosityLevel,  CharPtr  msg) 

{ 
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if  (msgVerbosityLevel  <=  _MsgVerbosity_)  { 
printf("%s",  msg); 
fflush(stdout); 

} 

} 


/* 

recog.c 

This  module  implements  the  recognizer. 

*/ 

#include  "utils.h" 

#include  "hashtbl.h" 

/* 

Hash  space  dimensions:  x,  y,  range. 

*! 

#define  _Dimension_  3 

static  DimensionType_DimensionMinVals[_DimensionJ  = 

{ -500,  -500,  -300  }; 

static  DimensionType_DimensionMaxVals|_Dimension_]  = 

{  499,  499,  299  }; 

static  int  _DimensionNumPartitions[_Dimension_|  = 

{  100,  100,  60}; 

/* 

Basis  dimension. 

*! 

I* 

We'll  do  3D  translation+rotation+scale  invariance,  so  we  need 
3  points  in  a  basis. 

*/ 

#define  _BasisDimension_  3 
I* 

ModelHashTable 

*/ 

static  HashTablePtr  _ModelHashTablePtr; 

/* 

Name  of  file  that  has  the  feature  points  of  all  of  the  model  and  test  targets. 
*1 
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static  String  _TargetsFileName; 

/* 

PDF  of  model  entries. 

*/ 

static  PDF  _ModelEntryPdf; 

/* 

Model  specification. 

*/ 

#define  _ModelDegreeIncrement_  30 

#define  _NumModelsPerModelType_  (360/_ModelDegreeIncrement_) 

#define  _NuniModelTypes_  4 

#define  _NumModels_  (_NumModelTypes_  *  _NumModelsPerModelType_) 

static  CharPtr  _ModelTypes[_NumModelTypes_]  = 

{ 

"hum_cargo", 

"ml  13", 

"m35_canvas", 

"m60" 

}; 

#defme  _MaxNumBasesDimO_  50 
#defme  _MaxNumBasesDiml_  50 
#define  _MaxNumBasesDim2_  50 

static  ModelNum  _ModelNum  =  0; 

static  int  NumbersOfModelPointsInModel 
LNumModelsJ;  /*  model  number  */ 

/* 

For  now,  we'll  set  these  to  0,  which  will  cause  a  hash  table  entry 
to  be  inserted  into  only  the  bin  in  which  it  lands,  and  not  into 
neighboring  bins. 

Strike  the  preceding  paragraph. 

We'll  insert  an  entry  into  a  hypercube  of  bins,  where  the  hypercube 
is  centered  at  the  bin  in  which  the  entry  lands,  and  the  size  of  the 
hypercube  in  each  dimension  is 

(_InsertEntryPartitionRangeMaxIndex  -  _InsertEntryPartitionRangeMinIndex  +  1) 
bins. 

Strike  the  preceding  paragraph. 

We'll  go  back  to  using  0  because  otherwise,  multiple  occurrences  of  a 
model  entry  can  vote  multiple  times,  which  isn't  the  desired  behavior. 
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*/ 

static  int_InsertEntryPartitionRangeMinIndex  =  0; 
static  int_InsertEntryPartitionRangeMaxIndex  =  0; 

/* 

These  are  similar  to  _InsertEntryPartitionRange...Index. 

*/ 

static  int_ComputeVotePartitionRangeMinIndex  =  -1; 
static  int  _ComputeVotePartitionRangeMaxIndex  =  1; 

I* 

Array  ModelTypesPoses  maps  (modelNumber)  to  (modelType,  poseX,  poseZ). 
*/ 

typedef  struct  ModelTypePose 

{ 

String  modelType; 

String  poseX; 

String  poseZ; 

}  ModelTypePose; 

static  ModelTypePose  ModelTypesPoses[_NumModelsJ; 

/* 

Array  Votes  maps  (modelNumber,  basis)  to  (V ote). 

*/ 

static  Vote  Votes 

LNumModelsJ  /*  model  number  */ 

LMaxNumBasesDimO  J  /*  basis  feature  number  0  */ 

[_MaxNumBasesDiml  J  /*  basis  feature  number  1  */ 

[_MaxNumBasesDim2  J  /*  basis  feature  number  2  */ 


static  int  NumbersOfModelEntriesThatContributedToVote 
|_NumModels_]  /*  model  number  */ 
[_MaxNumBasesDimO_]  /*  basis  feature  number  0  */ 
[_MaxNumBasesDiml  J  /*  basis  feature  number  1  */ 
|_MaxNumBasesDim2J  /*  basis  feature  number  2  */ 


#defme  _VotePenaltyForUnmatchedModelPoint_  (3.0) 

/* 

Array  ModelNumBasisVoteArray  maps  (int)  to  (ModelNumBasisVote). 
*1 

typedef  struct  ModelNumBasisVote 

{ 

ModelNum  modelNum; 

FeatureNum  basisFeatureNumO; 
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FeatureNum  basisFeatureNuml; 

FeatureNum  basisFeatureNum2; 

Vote  vote; 

}  ModelNumBasisVote; 

#define  ModelNumBasisVoteArraySize  \ 

(_NumModels_  *  _MaxNumBasesDimO_*_MaxNumBasesDiml_*_MaxNumBasesDim2_3 
static  ModelNumBasisVote  ModelNumBasisVoteArray[  ModelNumBasisVoteArraySize  ]; 
#defme  _NumWinningModelBasisPairs_  30 
/* 

Test  target. 

*/ 

static  String  _TestTargetType; 

static  String  TestTargetPoseX; 

static  String  _TestTargetPoseZ; 

static  String  _TestTargetBasisFeatureNumO; 

static  String  TestTargetBasisFeatureNuml ; 

static  String  _TestTargetBasisFeatureNum2; 

static  String  _TestTargetPlusMinusRandomUniformNoise; 

/* 

TargetPoints 

Holds  the  feature  points  of  a  target. 

*/ 

#define  _MaxNumTargetPoints_  50 
typedef  struct  TargetPoints 
{ 

Point  points|_MaxNumTargetPointsJ; 
int  numPoints; 

}  TargetPoints; 

typedef  TargetPoints  *TargetPointsPtr; 

static  void  Init_TargetPoints(TargetPointsPtr  tpp) 

{ 

int  i; 

for  (i  =  0;  i  <  _MaxNumTargetPoints_;  i-H-)  { 
tpp->points[i]  =  New_Point(_Dimension_); 

} 

tpp->numPoints  =  0; 

} 

static  void  UnInit_TargetPoints(TargetPointsPtr  tpp) 

{ 

int  i; 
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for  (i  =  0;  i  <  _MaxNuinTargetPoints_;  i-H-)  { 
Destroy_Point(tpp->points[i]); 

} 

tpp->numPoints  =  0; 

} 

static  void  Print_TargetPoints(int  tpVerbosity,  TargetPointsPtr  tpp) 

{ 

int  i; 

if  (tpVerbosity  <=  _MsgVerbosity_)  { 
for  (i  =  0;  i  <  tpp->numPoints;  i-H-)  { 
printf("%8 .2At%8 .2f\t%8.2f\n", 
tpp->points[i][0], 
tpp->points[i][l], 
tpp->points[i][2] 

); 

} 

fflush(stdout); 

} 

} 


Read  target  (targetType,  targetPoseX,  targetPoseZ)'s  feature  points 
from  file  targetsFileName  and  store  them  in  TargetPoints  *tpp. 

*1 

static  void  ReadTargetPointsFromTargetsFile 

( 

TargetPointsPtr  tpp, 

CharPtr  targetType, 

CharPtr  targetPoseX, 

CharPtr  targetPoseZ, 

CharPtr  targetsFileName, 
boolean  targetlsModel 

) 

{ 


FILE  *fp; 
int  retumCode; 

String  string; 

fp  =  fopen(targetsFileName,  "r"); 

Assert(fp  !=NULL,  "ReadTargetPointsFromTargetsFile();  fopen()"); 
strcpy(string, 

retumCode  =  fscanf(fp,  "%s",  string); 
while  (retumCode  !=  EOF)  { 
if  (!strcmp(string,  targetType))  { 
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String  string  1,  string2,  stringS; 


retumCode  =  fscanf(^,  "%s",  stringl); 
retumCode  =  fscanf(fp,  "%s",  string2); 
retumCode  =  fscanf(^,  "%s",  stringS); 

if  ( !strcmp(string2,  targetPoseX)  &&  !strcmp(string3,  targetPoseZ) )  { 
String  string4; 

/*  Eat  filename.  */ 
strcpy(string4, 

retumCode  =  fscanf(fp,  "%s",  string4); 
if  (4  <=  _MsgVerbosity_)  { 
printf("%s\n",  string4); 
fflush(stdout); 

} 


tpp->numPoints  =  0; 
strcpy(string4, 

retumCode  =  fscanf(fp,  "%s",  string4); 

while  ( (string4  !=  NULL)  &&  strcmp(string4,  "End")  )  { 

String  Strings,  string6; 

float  targetX,  targetY,  targetRange; 

retumCode  =  fscanf(fp,  "%s",  stringS); 
retumCode  =  fscanf(fj),  "%s",  string6); 

sscanf(string4,  "%f' ,  &targetX); 
sscanf(stringS,  "%f',  &targetY); 
sscanf(string6,  "%f',  &targetRange); 
if  (4  <=  _MsgVerbosity_)  { 

printf("%d\t%d\t%d\n",  (int)targetX,  (int)targetY,  (int)targetRange); 
fflush(stdout); 

} 

tpp->points[tpp->numPoints][0]  =  targetX; 
tpp->points[tpp->numPoints][l]  =  targetY; 
tpp->points[tpp->numPoints][2]  =  targetRange; 
tpp->numPoints-H-; 

strcpy(string4, ""); 

retumCode  =  fscanf(fp,  "%s",  string4); 

} 

break; 

} 

} 

strcpy(string, ""); 

retumCode  =  fscanf(^,  "%s",  string); 

} 

if  (targetlsModel)  { 

NumbersOfModelPointsInModel|_ModelNum]  =  tpp->numPoints; 
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} 


returaCode  =  fclose(fp); 

Assert(retumCode  !=  EOF,  "ReadTargetPointsFromTargetsFile():  fclose()"); 


} 

#define  _RandomIntMod_  256 

static  float  GetPlusMinusRandomUniformNoise(float  plusMinusRandomUniformNoise) 

{ 

int  randomint; 
float  randomFloat; 

randomint  =  randQ  %  _RandomIntMod_; 

randomFloat  =  ((float)randomInt)/((float)_RandomIntMod_); 

randomFloat  *=  (2*plusMinusRandomUniformNoise); 

randomFloat  -=  plusMinusRandomUniformNoise; 

return  randomFloat;  , 

} 

static  void  AddPlusMinusRandomUniformNoiseToTargetPoints 
(TargetPointsPtr  tpp,  float  plusMinusRandomUniformNoise) 

{ 


int  i; 

for  (i  =  0;  i  <  tpp->numPoints;  i-H-)  { 

float  noiseO  =  GetPlusMinusRandomUniformNoise(plusMinusRandomUniformNoise); 
float  noise  1  =  GetPlusMinusRandomUniformNoise(plusMinusRandomUniformNoise); 
float  noise2  =  GetPIusMinusRandomUniformNoise(plusMinusRandomUniformNoise); 
tpp->points[i][0]  +=  noiseO; 
tpp->points[i][l]  +=  noise  1; 
tpp->points[i][2]  +=  noise2; 

} 


} 

static  void  InsertTargetPointRelativeToBasisIntoModelHashTable 
(Point  tprb,  ModelNum  modelNum,  Basis  basis) 

{ 


HashTableEntiyPtr  ep  = 
New_Set_HashTableEntry 
( 

_Dimension_, 

_BasisDimension_, 

tprb, 

modelNum, 

basis, 

&_ModelEntryPdf, 
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NULL,  /*  NOT  IMPLEMENTED  YET  *! 
_FeatureTypePoint_ 

); 


Insert_HashTablePtr_EntryPtr 

( 

_ModeIHashTablePtr,  ep, 

_InsertEntryPartitionRangeMinIndex,_InsertEntryPartitionRangeMaxIndex 

); 


} 

static  void  ComputeTargetPointRelativeToBasis 
(TargetPointsI^  tpp.  Basis  basis.  Point  tp,  Point  tprb) 

{ 


FeatureNum  bfiiO  =  basis[0]; 

FeatureNum  bfhl  =  basis[l]; 

FeatureNum  bfh2  =  basis[2]; 

Vector  pO  =  tpp->points[bfhO]; 

Vector  pi  =  tpp->points[bfhl]; 

Vector  p2  =  tpp->points[bfh2]; 

Vector  dl  =  New_Vector(_Dimension_); 

Vector  d2  =  New_Vector(_Dimension_); 

Vector  d3  =  New_Vector(_Dimension_); 

Vector  d4  =  New_Vector(_Dimension_); 

Element  nl; 

Element  n3; 

Element  n4; 

Vector  vO  =  New_Vector(_Dimension_); 

Vector  vl  =  New_Vector(_Dimension_); 

Vector  v2  =  New_Vector(_Dimension_); 

Vector  d  =  New_Vector(_Dimension_); 

Sub_Vector_Vector(_Dimension_,  pi,  pO,  dl); 
nl  =  Get_2Norm_Vector(_Dimension_,  dl); 
Mult_Vector_Scalar(_Dimension_,  dl,  1.0/nl,  vO); 

Sub_Vector_Vector(_Dimension_,  p2,  pO,  d2); 
CrossProduct_Vector_Vector_3(dl,  d2,  d3); 
n3  =  Get_2Norm_Vector(_Dimension_,  d3); 
Mult_Vector_Scalar(_pimension_,  d3,  1.0/n3,  vl); 

CrossProduct_Vector_Vector_3(dl,  d3,  d4); 
n4  =  Get_2Norm_Vector(_Dimension_,  d4); 
Mult_Vector_Scalar(_Dimension_,  d4,  1.0/n4,  v2); 
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Sub_Vector_Vector(_Dimension_,  tp,  pO,  d); 


tprb[0]  =  DotProduct_Vector_Vector(_Dimension_,  d,  vO); 
tprb[l]  =  DotProduct_Vector_Vector(_Dimension_,  d,  vl); 
tprb[2]  =  DotProduct_Vector_Vector(_Dimension_,  d,  v2); 


Destroy_V  ector(d  1 ); 
Destroy_Vector(d2); 
Destroy_Vector(d3); 
Destroy_Vector(d4); 


Destroy_Vector(vO); 
Destroy_V  ector(v  1 ) ; 
Destroy_Vector(v2); 


Destroy_Vector(d); 


} 

static  void  ComputeTargetPointsRelativeToBasis 
(TargetPointsI^  tpp,  Basis  basis,  TargetPointsPtr  tprbp) 

{ 


int  i; 

for  (i  =  0;  i  <  tpp->numPoints;  i-H-)  { 
ComputeTargetPointRelativeToBasis 
(tpp,  basis,  tpp->points[i],  tprbp->points[i]); 

} 

tprbp->numPoints  =  tpp->numPoints; 


} 

static  void  InsertTargetPointsRelativeToBasisIntoModelHashTable 
(TargetPointsPtr  tprbp,  ModelNum  modelNum,  Basis  basis) 

{ 


int  i; 

FeatureNum  basisFeatureNumO  =  basis[0]; 

FeatureNum  basisFeatureNuml  =  basis[l]; 

FeatureNum  basisFeatureNum2  =  basis[2]; 

for  (i  =  0;  i  <  tprbp->numPoints;  i++)  { 

Point  tprb  =  tprbp->points[i]; 

InsertT  argetPo  intRe  lativeT  oBasisIntoModelHashT  ab  le 
(tprb,  modelNum,  basis); 

if  (4  <=  _MsgVerbosity_)  { 
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printf("Inserted  target  point  relative  to  basis:  point=(%d,%d,%d),  modelNuin=%d, 

basis=(%d,%d,%d)\n", 

(int)tprb[0], 

(int)tprb[l], 

(int)tprb[2], 
modelNum, 
basisFeatureNumO, 
basisFeatureNum  1 , 
basisFeatureNum2 
); 

fflush(stdout); 

} 

} 

} 

static  void  ComputeAndInsertTargetPointsRelativeToBasisIntoModelHashTable 

(TargetPointsPtr  tpp,  TargetPointsPtr  tprbp,  ModelNum  modelNum) 

{ 


int  tppNumPoints  =  tpp->numPoints; 

int  i; 
intj; 
intk; 


int  iStart  =  0; 

int  iEnd  =  (int)((float)tppNumPoints  *  (2.0/3 .0)); 

intjStart  =  iEnd+  1; 

int  jEnd  =  (tppNumPoints  - 1)  - 1; 


for  (i  =  iStart;  i  <=  iEnd;  i-H-) 
for  0  =  jStart;  j  <=  jEnd;  j++) 
for  (k  =  (j+l);  k  <=  (tppNumPoints  - 1);  k++) 

{ 

FeatureNum  basisFeatureNumO  =  i; 

FeatureNum  basisFeatureNum  1  =  j; 

FeatureNum  basisFeatureNum2  =  k; 

Basis  basis  =  New_Basis(_BasisDimension_); 
basis[0]  =  basisFeatureNumO; 
basis[l]  =  basisFeatureNum  1; 
basis[2]  =  basisFeatureNum2; 

ComputeTargetPointsRelativeToBasis(tpp,  basis,  tprbp); 
InsertTargetPointsRelativeToBasisIntoModelHashTable 
(tprbp,  modelNum,  basis); 

Destroy_Basis(basis); 

} 


'} 
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static  void  InsertModelIntoModelHashTable 

( 

TargetPointsPtr  tpp,  TargetPointsPtr  tprbp, 

CharPtr  modelType,  CharPtr  targetPoseX,  CharPtr  targetsFileName 

) 

{ 

int  i; 

for  (i  =  0;  i  <  360;  i  +=  _ModelDegreeIncrement_)  { 

String  targetPoseZ; 
sprintf(targetPoseZ,  "%d",  i); 

strcpy(ModelTypesPoses[_ModelNum]  .modelType,  modelType); 
strcpy(ModelTypesPoses[_ModelNum]  .poseX,  targetPoseX); 
strcpy(ModelTypesPosesLModelNum]  .poseZ,  targetPoseZ); 

ReadT  argetPointsFromT  argetsF  ile 

(tpp,  modelType,  targetPoseX,  targetPoseZ,  targetsFileName,  TRUE); 
ComputeAndInsertTargetPointsRelativeToBasisIntoModelHashTable 
(tpp,  tprbp,  _ModelNum); 

_ModelNum++; 
if  (0  <=  _MsgVerbosity_)  { 

printf("Inserted  model=(type=%s,  poseX=%s,  poseZ=%s)  from  %s\n", 
modelType, 
targetPoseX, 
targetPoseZ, 
targetsFileName 
); 

fflush(stdout); 

} 

} 

} 

static  void  CreateModelHashTable() 

{ 


TargetPoints  targetPoints; 

T  argetPoints  targetPointsRelati  veT  oBasi  s; 

PrintMsg(0,  "Creating  and  initializing  empty  ModelHashTable  ...\n"); 
_ModelHashTablePtr  = 

NewHashTable 

( 

_Dimension_, 

_DimensionMinVals, 

_DimensionMaxV  als, 

_DimensionNumPartitions 

); 

PrintMsg(0,  "Created  and  initialized  empty  ModelHashTable\n"); 
if  (0  <=  _MsgVerbosity_)  { 
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printf("ModelHashTable:  dimension=%d;  niinVaIs=%d,%d,%d;  maxVals=%d,%d,%d, 
numPartitions=%d,%d,%d;  partitionSizes=%.2f,%.2f,%.2f\n", 

_Dimension_, 

(int)_DimensionMinVals[0], 

(int)_DimensionMinValsn], 

(int)_DimensionMinVals[2], 

(int)_DimensionMaxV  als[0] , 

(int)_DimensionMaxV  als[  1  ] , 

(int)_DimensionMaxVals[2], 

(int)_DimensionNumPartitions[0], 

(int)_DimensionNumPartitions[  1  ], 

(int)_DimensionNumPartitions[2], 

Get_HashTablePtr_DimensionPartitionSizel(_ModelHashTablePtr,  0), 
Get_HashTablePtr_DimensionPartitionSizeI(_ModelHashTablePtr,  1), 
Get_HashTablePtr_DimensionPartitionSizeI(_ModelHashTablePtr,  2) 

); 

fflush(stdout); 

} 


Init_T  argetPoints(&targetPoints); 
Init_TargetPoints(&targetPointsRelativeToBasis); 

_ModelNum  =  0; 


InsertModelIntoModelHashT able(&targetPoints,  &targetPointsRelativeT oBasis, 
_ModelTypes[0],  "0",  _TargetsFileName); 

InsertModelIntoModelHashT able(&targetPoints,  &targetPointsRelativeT oBasis, 
_ModelTypes[l],  "0",  _TargetsFileName); 

InsertModelIntoModelHashTable(&targetPoints,  &targetPointsRelativeToBasis, 
_ModelTypes[2],  "0",  _TargetsFileName); 

InsertModelIntoModelHashTable(&targetPoints,  &targetPointsRelativeToBasis, 
_ModelTypes[3],  "0",  _TargetsFileName); 

UnInit_TargetPoints(«&targetPoints); 

UnInit_TargetPoints(&targetPointsRelativeToBasis); 


} 


/* 

static  void  ComputeVotesInModelHashTableForEntry 
(HashTableEntryPtr  ep) 

{ 


HashTableEntiyListPtr  entryLp; 
entryLp  = 

GetHashTableEntryListForEntry(_ModelHashT  ablePtr,  ep); 


A-28 


ComputeVotesInHashTableEntryListForEntry(_ModelHashTablePtr,  entryLp,  ep); 


} 

*! 

static  void  ComputeVotesInModelHashTableForEntry 
(HashTableEntryPtr  ep) 

{ 


ComputeVotesInHashTableForEntry 

( 

ModelHashTablePtr,  ep, 

_ComputeVotePaititionRangeMinIndex,  _ComputeVotePartitionRangeMaxIndex 

); 


} 

static  void  ComputeV otesInModelHashT ableForT argetPointRelativeT oBasis 
(Point  tprb,  Basis  basis) 

{ 


HashTableEntryPtr  ep  = 
New_Set_HashTableEntry 
( 

_Dimension_, 

_BasisDiniension_, 

tprb, 

_ModelNumNul  1_, 
basis, 

NULL, 

NULL, 

_FeatureTypePoint_ 

); 


ComputeVotesInModelHashTableForEntiy(ep); 


} 

static  void  ComputeVotesInModelHashTableForTargetPointsRelativeToBasis 
(TargetPointsF^  tprbp.  Basis  basis) 

{ 


int  i; 

for  (i  =  0;  i  <  tprbp->numPoints;  i-H-)  { 

Point  tprb  =  tprbp->points[i]; 

ComputeVotesInModelHashTableForTargetPointRelativeToBasis 
(tprb,  basis); 
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} 


} 

static  void  Histogram VotesInModelHashTable() 

{ 


int  numBuckets  =  Get_HashTablePtr_NumBuckets(_ModelHashTablePtr); 

int  i; 

int  jO; 

intjl; 

intj2; 

PrintMsg(0,  "Histogramming  votes  in  model  hash  table  ...\n"); 

/*  Initialize  Votes.  */ 
for  (i  =  0;  i  <  _NumModels_;  i++)  { 
for  (jO  =  0;  jO  <  _MaxNumBasesDimO_;  jO-H-)  { 
for(jl  =0;jl  <_MaxNumBasesDiml_;  jl-H-)  { 
for  (j2  =  0;  j2  <  _MaxNumBasesDim2_;  j2++)  { 

Votes[i]00]Dl][j2]  =_VoteNull_; 

} 

} 

} 

} 

/*  Initialize  NumbersOfModelEntriesThatContributedToVote.  */ 
for  (i  =  0;  i  <  _NumModels_;  i-H-)  { 
for  (jO  =  0;  jO  <  _MaxNumBasesDimO_;  jO-H-)  { 
for  (j  1  =  0;  j  1  <  _MaxNumBasesDiml_;  j  1  ++)  { 
for  (j2  =  0;  j2  <  _MaxNumBasesDim2_;  j2-H-)  { 
NumbersOfModelEntriesThatContributedToVote[i][jO][jl]|j2]  =  0; 

} 

} 

} 

} 

f* 

Histogram  votes  for  matching  model  entries  in  model  hash  table. 

*1 

for  (i  =  0;  i  <  numBuckets;  1++)  { 

HashTableBucketPtr  bp  =  Get_HashTablePtr_BucketPtrI(_ModelHashTablePtr,  i); 
HashTableEntryListPtr  Ip  =  bp; 

if  (Get_HashTableEntryListPtr_VotesHaveBeenComputed(lp))  { 
HashTableEntryNodePtr  Inp  =  Get_HashTableEntryListPtr_FirstNodePtr(lp); 
while  (lnp!=  NULL)  { 

Vote  InpVote  =  Get_HashTableEntryNodePtr_Vote(lnp); 

HashTableEntryPtr  lep  =  Get_HashTableEntryNodePtr_EntiyPtr(lnp); 
ModelNum  lepModelNum  =  Get_HashTableEntryPtr_ModelNum(lep); 
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Basis  lepBasis  =  Get_HashTableEntryPtr_Basis(lep); 
FeatureNum  lepBasisFeatureNumO  =  lepBasis[0]; 
FeatureNum  lepBasisFeatureNuml  =  lepBasis[l]; 
FeatureNum  lepBasisFeatureNum2  =  lepBasis[2]; 

if  (InpVote  =  _VoteNull_)  { 

/*  model  entry  didn't  match  */ 

/*  do  nothing  */ 

}  else  { 

/*  model  entry  matched  */ 
if( 

Votes 

[lepModelNum] 

[lepBasisF  eatureN  umO] 

[lepBasisFeatureNum  1  ] 

[lepBasisFeatureNum2] 

=  _VoteNull_ 

){ 

Votes 

[lepModelNum] 

[lepBasisFeatureNumO] 

[lepBasisFeatureNum  1  ] 

[lepBasisFeatureNum2] 

=  InpVote; 

}  else  { 

Votes 

[lepModelNum] 

[lepBasisFeatureNumO] 

[lepBasisFeatureNuml] 

[lepBasisFeatureNum2] 

+=  InpVote; 

} 

NumbersOfModelEntriesThatContributedToVote 

[lepModelNum] 

[lepBasisFeatureNumO] 

[lepBasisFeatureNum  1  ] 

[lepBasisFeatureNum2] 

++; 

} 

Inp  =  Get_HashTableEntryNodePtr_NextPtr(lnp); 


} 


} 

} 


/* 

Add  penalties  to  histogram  for  unmatched  model  entries  in  model  hash  table. 
*/ 
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for  (i  =  0;  i  <  _NumModels_;  i-H-)  { 
for  (jO  =  0;  jO  <  _MaxNutnBasesDimO_;  jO-H-)  { 
for(jl  =0;jl  <_MaxNumBasesDiml_;  jl++)  { 
for  (j2  =  0;  j2  <  _MaxNumBasesDim2_;  j2++)  { 
if(Votes[i][jO][jl][j2]  =_VoteNullJ  { 

/*  do  nothing  */ 

}  else  { 

int  numUnmatchedModelPoints  = 

( 

NumbersOfModelPointsInModel  [i] 

NumbersOfModelEntriesThatContributedToVote[i][jO]|jl][j2] 

); 

Votes[i]00][jl]02]  -= 
numUnmatchedModelPoints 
*  _VotePenaltyForUnmatchedModelPoint_; 

} 

} 

} 

} 

} 

PrintMsg(0,  "Histogrammed  votes  in  model  hash  tableVn"); 


static  void  ComputeAndPrintWinningModelBasisPairsInHistogramQ 

{ 


int  i; 

intjO; 

intjl; 

intj2; 

intj; 

intk; 

printf("Computing  top  %d  model,  basis  pairs  sorted  on  vote  ...\n", 
_NumWinningModelBasisPairs_); 

/*  Initialize  ModelNumBasisVoteArray.  */ 
k  =  0; 

for  (i  =  0;  i  <  _NumModels_;  i++)  { 
for  (jO  =  0;  jO  <  _MaxNumBasesDimO_;  jO-H-)  { 
for(jl  =0;jl  <_MaxNumBasesDiml_;  jl-H-)  { 
for  Q2  =  0;  j2  <  _MaxNumBasesDim2_;  j2-H-)  { 
ModelNumBasisVoteArray[k].modelNum  =  i; 
ModelNumBasisVoteArray[k].basisFeatureNumO  =j0; 
ModelNumBasisVoteArray[k].basisFeatureNuml  =  j  1; 
ModelNumBasisVoteArray[k].basisFeatureNum2  =j2; 
ModelNumBasisVoteArrayfkJ.vote  =  Votes[i][jO]0 1]D2]; 
k++; 
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} 

} 

} 

} 

I* 

Sort  ModelNumBasisVoteArray,  but  to  get  only  the  top 
_NumWinningModelBasisPairs_. 

*/ 

for  (i  =  0;  i  <=  (_NumWinningModelBasisPairs_-l);  1++)  { 

//  Find  min  in  rest  of  array, 
int  minindex  =  i; 

for  (j  =  (ModelNumBasisVoteArraySize-1);  j++)  { 

if 

( 

ModelNumBasisVoteArrayU]  .vote 
>  ModelNumBasisVoteArray[minIndex].vote 

){ 

minindex  =  j; 

} 

} 

//  Swap  current  and  min. 

{ 

ModelNumBasisVote  temp  =  ModelNumBasisVoteArray[i]; 
ModeINumBasisVoteArray[i]  =  ModelNumBasisVoteArray[minIndex]; 
ModelNumBasisVoteArray[minIndex]  =  temp; 

} 


} 

/* 

Print  top  _NumWinningModelBasisPairs_  elements  of  ModelNumBasisVoteArray. 

*/ 

if  (0  <=  _MsgVerbosity_)  { 

printf("Top  %d  model,  basis  pairs  sorted  on  vote:\n", 
_NumWinningModelBasisPairs_3; 
for  (i  =  0;  i  <_NumWinningModelBasisPairs_;  i-H-)  { 
if(ModelNumBasisVoteArray[i].vote  !=_VoteNull_)  { 

printf("modelNum=%2d,basis=(%2d,%2d,%2d),vote=%8.2f,  %2d/%2d  pts  matched, 
%s,%4s,%4s\n", 

ModelNumBasisV  oteArray[i]  .modelNum, 
ModelNumBasisVoteArray[i].basisFeatureNumO, 

ModelNumBasisVoteArrayfi]  .basisFeatureNum  1 , 

ModelNumBasisV  oteArrayp]  .basisFeatureNum2, 

ModelNumBasisV  oteArray  [i]  .vote, 

NumbersOfModelEntriesThatContributedT  oV  ote 
[ModelNumBasisVoteArray[i].modelNum] 
[ModelNumBasisVoteArray[i].basisFeatureNumO] 

[ModelNumBasisVoteArray[i]  .basisFeatureNum  1  ] 
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[ModelNumBasisV  oteArray[i]  .basisFeatureNum2], 
NumbersOfModelPointsInModel 
[ModelNumBasisVoteArray[i].modelNum], 
ModelTypesPoses[ModelNumBasisVoteArray[i],modelNum].modelType, 
ModelTypesPoses[ModelNumBasisVoteArray[i].modelNum].poseX, 
ModelTypesPoses[ModelNumBasisVoteAiTay[i].modelNum].poseZ 
); 

} 

} 

} 


} 

/* 

main() 

*1 

tnain(int  argc,  char  *argy[]) 

{ 


TargetPoints  testTargetPoints; 
float  testTargetPlusMinusRandomUniformNoise; 
TargetPoints  testTargetPointsRelativeToBasis; 
FeatureNum  testTargetBasisFeatureNumO; 
FeatureNum  testTargetBasisFeatureNuml ; 
FeatureNum  testTargetBasisFeatureNum2; 

Basis  testTargetBasis; 

int  modelEntryPdfType; 
int  modelEntryPdfDimension; 

Point  modelEntryPdfMean; 

Matrix  modelEntiyPdfCov; 

Element  modelEntryPdfDetCov; 

Matrk  modelEntryPdfInvCov; 

Element  modelEntryPdfCovSigmaO; 

Element  modelEntryPdfCovSigmal ; 

Element  modelEntryPdfCovSigma2; 

PrintMsg(0,  "Entered  main()\n"); 

/*  Check  and  process  arguments.  */ 

if  ( (argc  ==  8)  1|  (argc  =  9) )  { 

strcpy(_TargetsFileName,  argv[l]); 
strcpy(_TestTargetType,  argv[2]); 
strcpy(_TestTargetPoseX,  argv[3]); 
strcpy(_TestTargetPoseZ,  argv[4]); 
strcpy(_TestTargetBasisFeatureNumO,  argv[5]); 
strcpy(_TestTargetBasisFeatureNum  1 ,  argv[6]); 
strcpy(_TestTargetBasisFeatureNum2,  argv[7]); 
if  (argc  =  9)  { 
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strcpy(_TestTargetPlusMinusRandoniUnifonnNoise,  argv[8]); 

}  else  { 

strcpy(_TestTargetPlusMinusRandomUniformNoise,  "0"); 

} 

}  else  { 

printf("%s:  Incorrect  arguments'^",  argv[0]); 

printf("Usage:  %s  <targetsFileName>  <testTargetType>  <testTargetPoseX>  <testTargetPoseZ> 
<testTargetBasisFeatureNumO>  <testTargetBasisFeatureNuml>  <testTargetBasisFeatureNum2> 
<testTargetPlusMinusRandomUniformNoise><optional><default=0>\n", 
argv[0]); 
exit(O); 


} 


/* 

Initialize  _ModeIEntryPdf. 

*/ 

modelEntryPdfXype  =  _PDFTypeGaussian_; 
Set_PDFPtr_Type(&_ModelEntryPdf,  modelEntryPdfType); 

modelEntryPdfDimension  =  _Dimension_; 

Set_PDFPtr_Dimension(&_ModelEntryPdf,  modelEntiyPdfDimension); 

modelEntryPdfMean  =  New_Point(_Dimension_); 
modelEntryPdfMean[0]  =  0; 
modelEntryPdfMean[l]  =  0; 
modelEntryPdfMean[2]  =  0; 

Set_PDFPtr_Mean(&_ModelEntryPdf,  modelEntryPdfMean); 

modelEntryPdfCovSigmaO  =  5.0; 
modelEntryPdfCovSigmal  =  5.0; 
modelEntiy'PdfCovSigma2  =  5.0; 

modelEntryPdfCov  =  New_Matrix(_Dimension_,  _Dimension_); 
Set_Matrix_ElementIJ 

(modelEntryPdfCov,  _Dimension_,  Dimension  ,  0,  0, 
(modelEntryPdfCovSigmaO*modelEntryPdfCovSigmaO)); 
Set_Matrix_EIementIJ 

(modelEntryPdfCov,  _Dimension_,  Dimension  ,  0,  1,  0); 
Set_Matrix_ElementIJ 

(modelEntryPdfCov,  _Dimension_,  _Dimension_,  0,  2,  0); 
Set_Matrix_ElementU 

(modelEntiyPdfCov,  _Dimension_,  _Dimension_,  1,  0,  0); 
Set_Matrix_ElementU 

(modelEntryPdfCov,  _Dimension_,  _Dimension_,  1,  I, 
(modelEntryPdfCovSigmal  *modelEntryPdfCovSigmal )); 
Set_Matrix_ElementIJ 
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(modelEntryPdfCov,  _Dimension_,  _Dimension_,  1,  2,  0); 
Set_Matrix_ElementIJ 

(modelEntryPdfCov,  Dimension  ,  _Dimension_,  2,  0,  0); 
Set_Matrix_ElementIJ 

(modelEntryPdfCov,  _Dimension_,  _Dimension_,  2,  1,  0); 
Set_Matrix_ElementIJ 

(modelEntryPdfCov,  _Dimension_,  _Dimension_,  2, 2, 
(modelEntryPdfCovS  igma2  *modelEntryPdfCovS  igma2)); 
Set_PDFPtr_Cov(&_ModelEntryPdf,  modelEntryPdfCov); 

modelEntryPdfDetCov  =  25*25*25; 

Set_PDFPtr_DetCov(&_ModelEntryPdf,  modelEntryPdfDetCov); 

modelEntryPdfInvCov  =  New_Matrix(_Dimension_,  _Dimension_); 
Set_Matrix_ElementIJ 

(modelEntryPdflnvCov,  _Dimension_,  _Dimension_,  0,  0, 
1.0/(modelEntryPdfCovSigma0*modelEntryPdfCovSigma0)); 
Set_Matrix_ElementIJ 

(modelEntryPdflnvCov,  _Dimension_,  _Dimension_,  0,  1,  0); 
Set_Matrix_ElementIJ 

(modelEntryPdflnvCov,  _Dimension_,  _Dimension_,  0,  2,  0); 
Set_Matrix_ElementIJ 

(modelEntryPdflnvCov,  _Dimension_,  _Dimension_,  1,  0,  0); 
Set_Matrix_ElementIJ 

(modelEntryPdflnvCov,  _Dimension_,  _Dimension_,  1, 1, 

1 .0/(modelEntryPdfCovSigmal  *modelEntryPdfCovSigmal )); 
Set_Matrix_ElementIJ 

(modelEhtiyPdflnvCov,  _Dimension_,  _Dimension_,  1,  2,  0); 
Set_Matrix_ElementIJ 

(modelEntryPdflnvCov,  _Dimension_,  _Dimension_,  2,  0,  0); 
Set_Matrix_ElementIJ 

(modelEntryPdflnvCov,  _Dimension_,  _Dimension_,  2,  1,  0); 
Set_Matrix_ElementIJ 

(modelEntryPdflnvCov,  _Dimension_,  _Dimension_,  2,  2, 
1.0/(modelEntryPdfCovSigma2*modelEntryPdfCovSigma2)); 
Set_PDFPtr_InvCov(&_ModelEntryPdf,  modelEntryPdflnvCov); 

/*  Create  model  hash  table.  */ 

CreateModelHashTableO; 

Init_TargetPomts(&testTargetPoints); 

Init_TargetPoints(«&testT  argetPointsRelativeT  oBasis); 


/*  Read  test  target  from  test  targets  file.  */ 

ReadT  argetPointsFromT  argetsF  ile 

( 

&testTargetPoints, 

_TestTargetType,  _TestTargetPoseX,  _TestTargetPoseZ, 
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_TargetsFileName, 

FALSE 

); 


if  (0  <=  _MsgVerbosity_)  { 

printfC'Read  test  target  =  (type=%s,  poseX=%s,  poseZ=%s)  from  %s:\n", 
_TestTargetType,  _TestTargetPoseX,  _TestTargetPoseZ, 
_TargetsFileName 
); 

fflush(stdout); 

} 

Print_TargetPoints(0,  &testTargetPoints); 

/*  Add  plus  or  minus  random  uniform  noise  to  test  target.  */ 

sscanf(_TestTargetPlusMinusRandomUniformNoise,  "%f' , 
&testTargetPlusMinusRandomUniformNoise); 

AddPlusMinusRandomUniformNoiseToTargetPoints 

(&testTargetPoints,testTargetPlusMinusRandomUniformNoise); 


if  (0  <=  _MsgVerbosity_)  { 

printf(" Added  -%.2f..%.2f  random  uniform  noise  to  test  target  =  (type=%s,  poseX=%s,  poseZ=%s)  from 
%s:\n", 

testTargetPlusMinusRandomUniformNoise, 

testTargetPlusMinusRandomUniformNoise, 

_TestTargetType,  TestTargetPoseX,  TestTargetPoseZ, 

_TargetsF  ileName 

); 

fflush(stdout); 

} 

Print_TargetPoints(0,  &testTargetPoints); 

/*  Choose  basis  for  test  target.  */ 

sscanf(_TestTargetBasisFeatureNumO,  "%d",  &testTargetBasisFeatureNumO); 

sscanf(_TestTargetBasisFeatureNuml,  "%d",  &testTargetBasisFeatureNuml); 

sscanf(_TestTargetBasisFeatureNuni2,  "%d",  &testTargetBasisFeatureNum2); 

testTargetBasis  =  New_Basis(_BasisDimension_); 

testTargetBasis[0]  =  testTargetBasisFeatureNumO; 

testTargetBasis[l]  =  testTargetBasisFeatureNuml; 

testTargetBasis[2]  =  testTargetBasisFeatureNum2; 

if  (0  <=  _MsgVerbosity_)  { 
printf("Chose  basis=(%d,%d,%d)\n", 
testTargetBasis[0], 
testTargetBasis[  1  ], 
testTargetBasis[2] 

); 

fflush(stdout); 
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} 


/*  Compute  test  target  relative  to  chosen  basis.  */ 

ComputeTargetPointsRelativeToBasis 

( 

&testTargetPoints,  testTargetBasis,  &testTargetPointsRelativeToBasis 

); 

if  (0  <=  _MsgVerbosity_)  { 

printf("Computed  test  target  relative  to  chosen  basis:\n"); 
fflush(stdout); 

} 

Print_TargetPoints(0,  &testTargetPointsRelativeToBasis); 

/* 

Compute  votes  in  model  hash  table  for  test  target  relative  to  chosen  basis. 
*/ 

ComputeVotesInModelHashTableForTargetPointsRelativeToBasis 
(&testTargetPointsRelativeToBasis,  testTargetBasis); 

Destroy_Basis(testT  argetBasis); 

UnInit_T  argetPoints(&testT  argetPoints); 
UnInit_TargetPoints(&testTargetPointsRelativeToBasis); 

/*  Histogram  votes  in  model  hash  table.  */ 

HistogramVoteslnModelHashTableO; 

/*  Compute  and  print  winning  model,  basis  pairs  in  histogram.  */ 
ComputeAndPrintWinningModelBasisPairsInHistogramO; 

PrintMsg(0,  "Exiting  main()\n"); 

} 


/* 

matrix.c 

*/ 

#include  "matrix.h" 

extern  Vector  New_Vector(int  dimension) 

{ 

Vector  vector  =  (Vector)malloc(dimension*sizeof(Element)); 
,  return  vector; 
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} 


extern  void  Destroy_Vector( Vector  vector) 

{ 

free(vector); 

} 

extern  void  Assign_Vector_Vector(int  dimension,  Vector  a,  Vector  b) 

{ 

int  i; 

for  (i  =  0;  i  <  dimension;  i++)  { 
b[i]  =  a[i]; 

} 

} 

extern  void  Add_Vector_Vector(int  dimension,  Vector  a.  Vector  b.  Vector  c) 

{ 

int  i; 

for  (i  =  0;  i  <  dimension;  i++)  { 
c[i]  =  a[i]  +  b[i]; 

} 

} 

extern  void  Sub_Vector_Vector(int  dimension.  Vector  a.  Vector  b.  Vector  c) 

{ 

int  i; 

for  (i  =  0;  i  <  dimension;  i-H-)  { 
c[i]  =  a[i]-b[i]; 

} 

} 

extern  Element  Get_2Norm_Vector(int  dimension.  Vector  a) 

{ 

Element  norm2  =  0; 
int  i; 

for  (i  =  0;  i  <  dimension;  i-H-)  { 
norm2  -t-=  a[i]*a[i]; 

} 

norm2  =  sqrt(norm2); 
return  norm2; 

} 

extern  void  Mult_Vector_Scalar(int  dimension.  Vector  a.  Element  e,  Vector  b) 

{ 

int  i; 

for  (i  =  0;  i  <  dimension;  iH-)  | 
b[i]  =  e*a[i]; 

} 

} 

extern  Element  DotProduct_Vector_Vector 
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(int  dimension,  Vector  a.  Vector  b) 

{ 

Element  dotProduct  =  0; 
int  i; 

for  (i  =  0;  i  <  dimension;  i-H-)  { 
dotProduct  +=  a[i]  *  b[i]; 

} 

return  dotProduct; 

} 

extern  void  CrossProduct_Vector_Vector_3 
(Vector  a.  Vector  b,  Vector  c) 

{ 

c[0]=a[l]*b[2]-a[2]*b[l]; 
c[l]=a[0]*b[2]-a[2]*b[0]; 
c[2]  =  a[0]*b[l]-a[l]*b[0]; 

} 

extern  Matrix  New_Matrix(int  numRows,  int  numCols) 

{ 

int  numElements  =  numRows*numCols; 

Matrix  matrix  =  (Matrix)malIoc(numElements*sizeof(Element)); 
return  matrix; 

} 

extern  void  Destroy_Matrix(Matrix  matrix) 

{ 

free(matrix); 

} 

extern  void  Copy_Matrix(Matrix  a.  Matrix  b,  int  numRows,  int  numCols) 

{ 

int  numElements  =  numRows*numCols; 
int  i; 

for  (i  =  0;  i  <  numElements;  1++)  { 
b[i]  =  a[i]; 

} 

} 


/* 

extern  float  det_matrix_3x3(matrix_3x3  m) 

{ 

return  m[0][0]  *  m[l][l]  *  m[2][2]  + 
m[0][l]*m[l][2]*m[2][0]  + 
m[0][2]*m[l][0]’^m[2][l]- 
m[0][2]*m[l][l]*m[2][0]- 
m[0][0]*m[l][2]*m[2][l]- 
m[0][l]*m[l][0]*m[2][2]; 

} 
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extern  float  det_matrix_4x4(niatrix_4x4  m) 

{ 

matrix_3x3  ml; 
matrix_3x3  m2; 
matrix_3x3  m3; 
matrix_3x3  m4; 

int  i; 
intj; 


for  (i  =  0  ;  i  <  3  ;  1++) 
forO  =  0;j  <3  { 

ml[i]lj]  =  m[i+  l][j  +  1]; 
m2[i][j]  =  m[i+l][j  +  a>0)]; 
m3[i]0]  =  m[i+l]D  +  (j>l)]; 
m4[i]Ij]  =  m[i  +  1]G]; 

} 

return  m[0][0]  *  det_matrix_3x3(ml) 

-  m[0][l]  *  det_matrix_3x3(m2) 

+  m[0][2]  *  det_matrix_3x3(m3) 

-  m[0][3]  *  det_matrix_3x3(m4); 

} 

*1 

I* 

extern  int  so!ve_4x4(vector_4  x,  matrix_4x4  A,  vector_4  z) 

{ 


float  detA; 

matrix_4x4  Ml; 
matrix_4x4  M2; 
matrix_4x4  M3; 
matrix_4x4  M4; 

float  detMl; 
float  detM2; 
float  detM3; 
float  detM4; 

detA  =  det_matrix_4x4(A); 
if  (detA  =  0)  { 
return  FALSE; 

} 

copy_matrix_4x4(A,  Ml); 
Ml[0][0]  =  z[0]; 

Ml[l][0]  =  z[l]; 

Ml[2][0]  =  z[2]; 

Ml[3][0]  =  z[3]; 
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detMl  =  det_matrix_4x4(MI); 


copy_matrix_4x4(A,  M2); 
M2[0][l]  =  z[0]; 

M2[l][l]  =  z[l]; 

M2[2][l]  =  z[2]; 

M2[3][l]  =  z[3]; 

detM2  =  det_matrix_4x4(M2); 


copy_matrix_4x4(A,  M3); 
M3[0][2]  =  z[0]; 

M3[l][2]  =  z[l]; 

M3[2][2]  =  z[2]; 

M3[3][2]  =  z[3]; 

detM3  =  det_matrix_4x4(M3); 


copy_matrix_4x4(A,  M4); 
M4[0][3]  =  z[0]; 

M4[l][3]  =  z[l]; 

M4[2][3]  =  z[2]; 

M4[3][3]  =  z[3]; 

detM4  =  det_matrix_4x4(M4); 

x[0]  =  detMl /detA; 
x[l]  =  detM2/detA; 
x[2]  =  detM3/detA; 
x[3]  =  detM4/detA; 

return  TRUE; 

} 

*/ 


extern  void  Mult_Vector_Matrix 

(Vector  V,  int  vDim,  Matrix  m,  int  mNumRows,  int  mNumCols,  Vector  w) 

{ 

int  i; 
intj; 

Assert(vDim  —  mNumRows,  "Mult_Vector_Matrix()"); 

for  (j  =  0;  j  <  mNumCols;  j-H-)  { 

Element  \yj  =  0; 

for  (i  =  0;  i  <  mNumRows;  i++)  { 

Element  tl  =  Get_Vector_ElementI(v,  i); 

Element  t2  =  Get_Matrix_ElementIJ(m,  mNumRows,  mNumCols,  i,  j); 
Element  product  =  tl  *t2; 

/* 

printf("tl=%f,  t2=%f,  product=%f\n",  tl,  t2,  product);  fflush(stdout); 

*1 

wj  +=  product; 
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} 

Set_Vector_ElementI(w,  j,  wj); 

} 

} 

extern  void  Mult_Matrix_Vector 

(Matrix  m,  int  mNumRows,  int  mNumCols,  Vector  v,  int  vDim,  Vector  w) 

{ 

int  i; 
intj; 

Assert(mNumCols  ==  vDim,  "Mult_Matrix_Vector()"); 

for  (i  =  0;  i  <  mNumRows;  i-H-)  { 

Element  wi  =  0; 

for  (j  =  0;  j  <  mNumCols;  j-H-)  { 
wi  +=  Get_Vector_ElementI(v,  j) 

*  Get_Matrix_ElementIJ(m,  mNumRows,  mNumCols,  i,  j); 

} 

Set_Vector_ElementI(w,  i,  wi); 

} 

} 

extern  void  Mult_Vector_Vector(Vector  vl.  Vector  v2,  int  vDim,  ElementPtr  wp) 

{ 

Element  w  =  0; 
intj; 

for  (j  =  0;j<  vDim;  j++)  { 
w  +=  Get_Vector_ElementI(vl,  j) 

*  Get_Vector_ElementI(v2,  j); 

} 

*wp  =  w; 

} 


#ifhdef  _hashtbl_h_ 

#define  _hashtbl_h_ 

/* 

hashtbl.h 

This  module  implements  the  n-dimensional  hash  table  data  type, 
which  includes  hash  table  entries. 

This  module  also  implements  compute  vote  functions. 

Search  for  the  comment  "HashTable  Creation  and  Access  Functions" 
to  locate  the  hash  table  creation  and  access  functions. 
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Search  for  the  comment  "Compute  Vote  Functions" 
to  locate  the  compute  vote  functions. 

*/ 

#include  "utils.h" 

#include  "matrix.h" 

/* 

DimensionType 

*/ 

typedef  float  DimensionType; 

typedef  DimensionType  *DimensionTypePtr; 

/* 

Point 

*1 

typedef  DimensionTypePtr  Point;  /*  array  dimension  of  DimensionType  */ 

extern  Point  New_Point(int  dimension); 
extern  void  Destroy_Point(Point  point); 

extern  void  Copy_Point(int  dimension,  Point  pi.  Point  p2);  /*  Copy  pi  to  p2.  */ 
extern  DimensionType  Get_Distance_Point_Point 
(int  dimension.  Point  pi.  Point  p2); 

/*  Compute  p3  =  pi  +  p2.  */ 

extern  void  Add_Point_Point(int  dimension.  Point  pi.  Point  p2.  Point  p3); 

/*  Compute  p3  =  pi  -  p2.  */ 

extern  void  Subtract_Point_Point(int  dimension.  Point  pi.  Point  p2.  Point  p3); 

/* 

ModelNum 

*/ 

typedef  int  ModelNum; 

#define  _ModelNumNull_  -1 
/* 

FeatureNum 

*/ 

typedef  int  FeatureNum; 

typedef  FeatureNum  *FeatureNumPtr; 

/* 

Basis 

*/ 
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typedef  FeatureNumPtr  Basis;  /*  array  dimension  of  FeatureNum  */ 
extern  Basis  New_Basis(int  dimension); 
extern  void  Destroy_Basis(Basis  basis); 

extern  void  Copy_Basis(int  dimension,  Basis  bl,  Basis  b2);  /*  Copy  bl  to  b2.  */ 
/* 

PDFType 

PDF 

*1 


typedef  int  PDFType; 

/*  PDFType-s  */ 

#define  _PDFTypeGaussian_  0 
typedef  struct  PDF 
{ 

PDFType  type; 
int  dimension; 

Point  mean; 

Matrix  cov;  /*  covariance  matrix  */ 

Element  detCov;  /*  determinant  of  covariance  matrix  */ 
Matrix  invCov;  /*  inverse  of  covariance  matrix  */ 
}PDF; 

#define  Get_PDFPtr_Type(pp)  \ 

((pp)->type) 

#defme  Get_PDFPtr_Dimension(pp)  \ 

((pp)->dimension) 

#define  Get_PDFPtr_Mean(pp)  \ 

((pp)->mean) 

#define  Get_PDFPtr_Cov(pp)  \ 

((pp).>cov) 

#define  Get_PDFPtr_DetCov(pp)  \ 

((pp)->detCov) 

#define  Get_PDFPtr_InvCov(pp)  \ 

((pp)->invCov) 

#defme  Set_PDFPtr_Type(pp,  t)  \ 

{ (pp)->type  =  (t); } 

#define  Set_PDFPtr_Dimension(pp,  d)  \ 

{ (pp)->dimension  =  (d); } 

#defme  Set_PDFPtr_Mean(pp,  m)  \ 

{  (pp)->mean  =  (m);  } 

#define  Set_PDFPtr_Cov(pp,  c)  \ 

{  (pp>>cov  =  (c); } 

#defme  Set_PDFPtr_DetCov(pp,  dc)  \ 

{ (pp)->detCov  =  (dc); } 

#defme  Set_PDFPtr_InvCov(pp,  ic)  \ 
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{  (pp)->invCov  =  (ic);  } 
typedef  PDF  *PDFPtr; 

/* 

NOT  IMPLEMENTED  YET. 

Stats 

*/ 

typedef  int  Stats; 
typedef  Stats  *StatsPtr; 

/* 

FeatureType 

*1 

typedef  int  FeatureType; 

/*  FeatureType-s  */ 

#define  _FeatureTypePoint_  0 

I* 

Vote 

*1 

/*  A  non-null  vote  is  >=  _VoteMin_.  */ 
typedef  float  Vote; 

#define  _VoteMin_  0 

#define_VoteNull_-l 

/* 

HashTableEntiy 

*/ 

typedef  struct  HashTableEntry 

{ 

Point  point; 

ModelNum  modelNum; 

Basis  basis; 

PDFPtr  pdfPtr; 

StatsPtr  statsPtr; 

FeatureType  FeatureType; 

Vote  vote; 

}  HashTableEntiy; 

#define  Get_HashTableEntiyPtr_Point(ep)  \ 
((ep)->point) 


#define  Get_HashTableEntryPtr_ModelNum(ep)  \ 
((ep)->modelNum) 

#define  Get_HashTableEntryPtr_Basis(ep)  \ 
((ep)->basis) 

#define  Get_HashTableEntryPtr_PdfPtr(ep)  \ 
((ep)->pdfPtr) 

#defme  Get_HashTableEntryPtr_StatsPtr(ep)  \ 
((ep)->statsPtr) 

#define  Get_HashTableEntryPtr_FeatureType(ep)  \ 
((ep)->featureType) 

#define  Get_HashTableEntryPtr_Vote(ep)  \ 
((ep)->vote) 

#define  Set_HashTableEntryPtr_Point(ep,  p)  \ 

{ (ep)->point  =  (p); } 

#define  Set_HashTableEntryPtr_ModelNum(ep,  mn)  \ 
{ (ep)->modelNum  =  (mn); } 

#define  Set_HashTableEntryPtr_Basis(ep,  b)  \ 

{ (ep)->basis  =  (b); } 

#define  Set_HashTableEntiyPtr_PdfPtr(ep,  pp)  \ 

{  (ep)->pdfPtr  =  (pp); } 

#define  Set_HashTableEntryPtr_StatsPtr(ep,  sp)  \ 

{ (ep)->statsF^  =  (sp); } 

#define  Set_HashTableEntryPtr_FeatureType(ep,  ft)  \ 
{ (ep)->featureType  =  (ft);  } 

#define  Set_HashTableEntryPtr_Vote(ep,  v)  \ 

{ (ep)->vote  =  (v); } 

typedef  HashTableEntry  *HashTableEntryPtr; 

extern  HashTableEntryPtr  New_HashTableEntry(); 

extern  HashTableEntryPtr  New_Set_HashTabIeEntry 

( 

int  dimension, 
int  basisDimension, 

Point  point, 

ModelNum  modelNum, 

Basis  basis, 

PDFPtrpdfPtr, 
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StatsPtr  statsPtr, 
FeatureType  featureType 
); 


/* 

Hash!  ableEntryN  ode 
*/ 

typedef  struct  HashTableEnttyNode  *HashTableEntryNodePtr; 

typedef  struct  HashTableEntryNode 

{ 

HashTableEntryPtr  entryPtr; 

DimensionType  distance;  /*  from  this  entry  to  center  of  this  bucket  */ 

/* 

Vote  vote; 

*1 

HashTableEntryNodePtr  nextPtr; 

}  HashTableEntryNode; 

#define  Get_HashTableEntryNodePtr_EntryPtr(np)  \ 

((np)->entryPtr) 

#define  Get_HashTableEntryNodePtr_Distance(np)  \ 

((np)->distance) 

#define  Get_HashTableEntryNodePtr_Vote(np)  \ 

( Get_HashTableEntryPtr_Vote((np)->entryPtr) ) 

/* 

((np)->vote) 

*1 

#define  Get_HashTableEntryNodePtr_NextPtr(np)  \ 

((np)->nextPtr) 

#define  Set_HashTableEntryNodePtr_Entrj/Ptr(np,  ep)  \ 

{ (np)->entiyPtr  =  (ep); } 

#defme  Set_HashTableEntryNodePtr_Distance(np,  d)  \ 

{  (np)->distance  =  (d); } 

#define  Set_HashTableEntryNodePtr_Vote(np,  v)  \ 

{  Set_HashTableEntryPtr_Vote((np)->entryPtr,  (v)); } 

I* 

{ (np)->vote  =  (v); } 

*/ 

#define  Set_HashTableEntryNodePtr_NextPtr(np,  nextp)  \ 
{(np)->nextPtr  =  (nextp);} 

extern  HashTableEntryNodePtr  New_HashTableEntryNode(); 
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/* 

HashTableEntryList 

*1 

typedef  struct  HashTableEntryList 

{ 

HashTableEntryNodePtr  firstNodePtr; 

HashTableEntryNodePtr  lastNodePtr; 
boolean  votesHaveBeenComputed; 

}  HashTableEntryList; 

typedef  HashT  ableEntryList  *HashT  ableEntryListPtr; 

#define  Get_HashTableEntryListPtr_FirstNodePtr(lp)  \ 

((lp)->firstNodePtr) 

#define  Get_HashTableEntryListPtr_LastNodePtr(lp)  \ 

((lp)->lastNodePtr) 

#define  Get_HashTableEntryListPtr_VotesHaveBeenComputed(lp)  \ 
((lp)->votesHaveBeenComputed) 

#define  Set_HashTableEntryListPtr_FirstNodePtr(lp,  np)  \ 

{ (lp)->firstNodePtr  =  (np);  } 

#define  Set_HashTableEntryListPtr_LastNodePtr(lp,  np)  \ 

{ (lp)->lastNodePtr  =  (np); } 

#define  Set_HashTableEntryListPtr_VotesHaveBeenComputed(lp,  b)  \ 

{  (lp)->votesHaveBeenComputed  =  (b); } 

extern  HashTableEntryListPtr  New_HashTableEntryList(); 

I* 

Insert  entry  *ep  at  the  head  position  of  entry  list  *lp. 

distance  is  the  distance  from  entry  *ep  to  the  center  of  the  bucket 

that  entry  list  *lp  represents. 

*/ 

extern  HashTableEntryListPtr  InsertHead_HashTableEntryListPtr_EntryPtr_Distance 
(HashTableEntryListPtr  Ip,  HashTableEntryPtr  ep,  DimensionType  distance); 

/* 

HashT  ableBucket 
*/ 

typedef  HashTableEntryList  HashTableBucket; 
typedef  HashTableBucket  *HashTableBucketPtr; 

/* 
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HashTable 

*/ 

typedef  struct  HashTable 

{ 

int  dimension; 

DimensionType  *dimensionMinVals; 

DimensionType  *dimensionMaxVals; 

int  *dimensionNumPartitions; 

DimensionType  *dimensionPartitionSizes; 

int  numBuckets; 

HashTableBucketPtr  *bucketPtrs; 

}  HashTable; 

typedef  HashTable  *HashTablePtr; 

#defme  Get_HashTablePtr_Dimension(htp)  \ 
((htp)->dimension) 

#defme  Get_HashTablePtr_DimensionMinValI(htp,  i)  \ 
((htp)->dimensionMinVals[(i)]) 

#define  Get_HashTablePtr_DimensionMaxValI(htp,  i)  \ 
((htp)->dimensionMaxVals[(i)]) 

#define  Get_HashTablePtr_DimensionNumPartitionI(htp,  i)  \ 
((htp)->dimensionNumPartitions[(i)]) 

#defme  Get_HashTablePtr_DimensionPartitionSizeI(htp,  i)  \ 
((htp)->dimensionPartitionSizes[(i)]) 

#define  Get_HashTablePtr_NumBuckets(htp)  \ 
((htp)->numBuckets) 

#defme  Get_HashTablePtr_BucketPtrI(htp,  i)  \ 
((htp)->bucketPtrs[(i)]) 

#define  Set_HashTabIePtr_Dimension(htp,  d)  \ 
((htp)->dimension  =  (d)) 

#define  Set_HashTablePtr_DimensionMinVals(htp,  vs)  \ 

{  (htp)->dimensionMinVals  =  (vs); } 

#define  Set_HashTablePtr_DimensionMaxVals(htp,  vs)  \ 

{ (htp)->dimensionMaxVals  =  (vs); } 

#defme  Set_HashTablePtr_DimensionMinValI(htp,  i,  v)  \ 

{ (htp)->dimensionMinVals[(i)]  =  (v); } 

#define  Set_HashTablePtr_DimensionMaxValI(htp,  i,  v)  \ 

{ (htp)->dimensionMaxVals[(i)]  =  (v); } 
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#defme  Set_HashTablePtr_DimensionNumPartitions(htp,  ps)  \ 

{ (htp)->dimensionNumPartitions  =  (ps); } 

#define  Set_HashTablePtr_DimensionPartitionSizes(htp,  pss)  \ 

{ (htp)->dimensionPartitionSizes  =  (pss); } 

#define  Set_HashTablePtr_DimensionNumPartitionI(htp,  i,  p)  \ 
{ (htp)->dimensionNumPartitions[(i)]  =  (p); } 

#define  Set_HashTablePtr_DiniensionPartitionSizeI(htp,  i,  ps)  \ 
{  (htp)->dimensionPartitionSizes[(i)]  =  (ps);  } 

#define  Set_HashTablePtr_NumBuckets(htp,  nb)  \ 

{ (htp)->numBuckets  =  (nb); } 

#defme  Set_HashTableftr_BucketPtrs(htp,  bps)  \ 

{ (htp)->bucketPtrs  =  (bps); } 

#define  Set_HashTablePtr_BucketPtrI(htp,  i,  bp)  \ 

{ (htp)->bucketPtrs[(i)]  =  (bp); } 

/* 

HashTable  Creation  and  Access  Functions 

*1 

extern  HashTablePtr  New_HashTable 

( 

int  dimension, 

DimensionType  *dimensionMinVals, 

DimensionType  *dimensionMaxVals, 
int  *dimensionNumPartitions 
); 


/* 

Determine  the  bucket  of  hash  table  *htp  in  which  point  "point"  lands  and 
compute  the  bucket's  bucket  number  and  bucket  midpoint. 

Return  the  bucket  number  and  set  "bucketMidpoint"  to  the  bucket  midpoint. 
*/ 

extern  int  Get_HashTablePtr_Point_BucketNum_BucketMidpoint 
(HashTablePtr  htp,  Point  point,  Point  bucketMidpoint); 

extern  void  InsertIntoHypercube_HashTablePtr_EntryPtr 

( 

HashTablePtr  htp,  HashTableEntryPtr  ep, 

int  partitionRangeMinIndex,  int  partitionRangeMaxIndex, 

Point  entryPoint,  int  dimension.  Point  point.  Point  bucketMidpoint, 
int  loopDimensionNum 
); 
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Insert  entry  *ep  into  hash  table  *htp. 

Insert  the  entry  into  all  buckets  in  an  n-dim.  rectangular  neighborhood 
of  the  entry,  where  the  n-dim.  rectangular  neighborhood  is  defined  by 
partitionRangeMinIndex  and  partitionRangeMaxIndex. 

*/ 

extern  HashTablePtr  Insert_HashTablePtr_EntryPtr 

( 

HashTablePtr  htp,  HashTableEntryPtr  ep, 

int  partitionRangeMinIndex,  int  partitionRangeMaxIndex 

); 


extern  HashTableEntryListPtr  GetHashTableEntryListForEntry 
(HashTablePtr  htp,  HashTableEntryPtr  ep); 

I* 

Compute  Vote  Functions 
*1 

extern  void  ComputeVotesInHypercubeForEntry 

( 

HashTablePtr  htp,  HashTableEntryPtr  ep, 

int  partitionRangeMinIndex,  int  partitionRangeMaxIndex, 

Point  entryPoint,  int  dimension.  Point  point.  Point  bucketMidpoint, 
int  loopDimensionNum 

); 


extern  void  ComputeVotesInHashTableForEntry 

( 

HashTablePtr  htp,  HashTableEntryPtr  ep, 

int  partitionRangeMinIndex,  int  partitionRangeMaxIndex 

); 

extern  void  ComputeVotesInHashTableEntryListForEntry 
(HashTablePtr  htp,  HashTableEntryListPtr  Ip,  HashTableEntryPtr  ep); 

extern  Vote  Compute_DistanceVote_PredPoint_ExtrPoint 

( 

int  dimension,  Point  predictedPoint,  Point  extractedPoint 

); 


I* 

Compute  and  return 

Iog(pdf_predictedPoint(extractedPoint)). 

*/ 

extern  float  Compute_Log_PDFPtr_PredPoint_ExtrPoint 
(PDFPtr  pdl^.  Point  predictedPoint,  Point  extractedPoint); 

/* 

Compute  and  return 
backgroundDistrFunc(extractedPoint) 

*/ 
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extern  float  Conipute_BackgroundDistr(Point  extractedPoint); 
typedef  float  (*  BackgroundDistrFuncPtr)(Point  extractedPoint); 

/* 

Compute  and  return 
vote  =  log 
( 

pdf_predictedPoint(extractedPoint) 

/  backgroundDistrFunc(extractedPoint) 

) 

*/ 

extern  Vote  Compute_Vote_PDFPtr_PredPoint_ExtrPoint_BackgroundDistrFuncPtr 

( 

PDFPtr  pdfp,  Point  predictedPoint,  Point  extractedPoint, 

BackgroundDistrFuncPtr  backgroundDistrFuncPtr 

); 

#endif 


#ifhdef_matrix_h_ 

#defme  _matrix_h_ 

/* 

matrix.h 

This  module  implements  matrix  and  vector  operations. 

*1 

#include  "utils.h" 

/* 

Element  of  a  matrix  or  vector. 

*/ 

typedef  float  Element; 
typedef  Element  *ElementPtr; 

/* 

Vector 

*1 

typedef  ElementPtr  Vector;  /*  array  dimension  of  Element  */ 
extern  Vector  New_Vector(int  dimension); 
extern  void  Destroy_Vector(Vector  vector); 
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#defme  Get_Vector_ElementI(v,  i)  \ 

(v[(i)]) 


#define  Set_Vector_ElementI(v,  i,  e)  \ 

{v[(i)]  =  (e);} 

/* 

b  =  a 
*/ 

extern  void  Assign_Vector_Vector(int  dimension,  Vector  a,  Vector  b); 

/* 

c  =  a  +  b 
*1 

extern  void  Add_Vector_Vector(int  dimension.  Vector  a.  Vector  b.  Vector  c); 
/* 

c  =  a-b 
*/ 

extern  void  Sub_Vector_Vector(int  dimension.  Vector  a.  Vector  b.  Vector  c); 

/* 

Return  2-norm  of  a. 

*/ 

extern  Element  Get_2Norm_Vector(int  dimension.  Vector  a); 

/* 

b  =  e  *  a 
*/ 

extern  void  Mult_Vector_Scalar(int  dimension.  Vector  a.  Element  e.  Vector  b); 
/♦ 

Return  a  *  b. 

*1 

extern  Element  DotProduct_Vector_Vector 
(int  dimension.  Vector  a.  Vector  b); 

/* 

c  =  axb 
*/ 

extern  void  CrossProduct_Vector_Vector_3 
(Vector  a,  Vector  b.  Vector  c); 

/* 

Matrix 

*1 

typedef  ElementPtr  Matrix;  /*  array  (numRows*numCols)  of  Element  */ 
extern  Matrix  New_Matrix(int  numRows,  int  numCols); 
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extern  void  Destroy_Matrix(Matrix  matrix); 


#define  Get_Matrix_ElementIJ(m,  nr,  nc,  i,  j)  \ 

(m[((i)*nc)+a)]) 

#define  Set_Matrix_ElementIJ(m,  nr,  nc,  i,  j,  e)  \ 

{m[((i)*nc)+(j)]  =  (e);} 

#define  Get_Matrix_ElementI(m,  nr,  nc,  i)  \ 

(m[(i)]) 

#define  Set_Matrix_ElementI(m,  nr,  nc,  i,  e)  \ 

{m[(i)]  =  (e);} 

/*  Copy  Matrix  a  to  Matrix  b.  */ 

extern  void  Copy_Matrix(Matrix  a,  Matrix  b,  int  numRows,  int  numCols); 

/*  Compute  and  return  the  determinant  of  matrix  m.  */ 

/* 

extern  float  det_matrix_3x3(matrix_3x3  m); 

*1 

/*  Compute  and  return  the  determinant  of  matrix  m.  */ 

/* 

extern  float  det_matrix_4x4(matrix_4x4  m); 

*/ 

/* - 

I 

I  Routine  Name:  solve_4x4  -  Solve  the  4-dim.  linear  system  Ax=z  for  x. 

I 

I  Purpose:  Solve  Ax=z  for  x,  where  A  is  a  4x4  matrix,  and 
I  z  and  X  are  4x1  vectors. 

j  Input:  z  -  A  4x1  vector. 

I  A  -  A  4x4  matrix. 

I 

I  Output:  X  -  A  4x1  vector,  the  solution. 

I 

I  Returns:  TRUE  (1)  on  success,  FALSE  (0)  otherwise 

I 

I  Written  By:  Raju  Jawalekar 
I  Date:  Oct.  23,  1996 

I  Modifications: 

I 

- ♦  / 

/* 

extern  int  solve_4x4(vector_4  x,  matrix_4x4  A,  vector_4  z); 

*/ 
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/♦ 

Compute  w  =  v*m. 

V 

extern  void  Mult_Vector_Matrix 

(Vector  V,  int  vDim,  Matrix  m,  int  mNumRows,  int  mNumCols,  Vector  w); 

/* 

Compute  w  =  m*v. 

*/ 

extern  void  Mult_Matrix_Vector 

(Matrix  m,  int  mNumRows,  int  mNumCols,  Vector  v,  int  vDim,  Vector  w); 

/* 

Compute  w  =  vl  *v2. 

*/ 

extern  void  Mult_Vector_Vector(Vector  vl.  Vector  v2,  int  vDim,  ElementPtr  wp); 
#endif 


#ifhdef_utils_h_ 

#define  _utils_h_ 

/* 

utils.h 

This  module  implements  various  utilities  -  basic  data  types, 
message  printing,  etc. 

*/ 

#include  <stdio.h> 

#include  <stdlib.h> 

#include  <math.h> 

#include  <limits.h> 

typedef  char  *CharPtr; 

#defme  _MaxNumCharsInString_  (256  -  1) 

typedef  char  String[_MaxNumCharsInString_  +  1];  /*  +  1  for^0'  */ 

typedef  int  boolean; 

#define  FALSE  0 
#defme  TRUE  1 

#define  PI  3.14159265359 

extern  int  _MsgVerbosity_; 

I* 
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If  not  b,  then  print  msg  on  stdout  and  exit. 

*/ 

extern  void  Assert(boolean  b,  CharPtr  msg); 

/* 

If  msgVerbosityLevel  is  <=  _MsgVerbosity_,  then  print  msg  on  stdout. 
*/ 

extern  void  PrintMsg(int  msgVerbosityLevel,  CharPtr  msg); 

#endif 


RUNl  Run  Script: 

ndhash  ../targets/targets.txt  hum_cargo  0  30  7  16  18  >  hum_cargo.0.30.out 
ndhash  ../targets/targets.txt  hum_cargo  0  45  12  20  24  >  hum_cargo.0.45.out 
ndhash  ../targets/targets.txt  hum_cargo  0  60  8  18  20  >  hum_cargo.0.60.out 
tail  -32  *hum_cargo*.out  >  hum_cargo.winners.out 

ndhash  ../targets/targets.txt  ml  13  0  30  7  10  12  >  ml  13.0.30.out 
ndhash  ../targets/targets.txt  ml  13  0  45  14  20  25  >  ml  13.0.45.out 
ndhash  ../targets/targets.txt  ml  13  0  60  8  12  15  >  ml  13.0.60.out 
tail  -32  *ml  13*.out  >  ml  13.winners.out 

ndhash  ../targets/targets.txt  m35_canvas  0  30  9  18  22  >  m35_canvas.0.30.out 
ndhash  ../targets/targets.txt  m35_canvas  0  45  12  22  30  >  m35_canvas.0.45.out 
ndhash  ../targets/targets.txt  m35_canvas  0  60  10  20  26  >  m35_canvas.0.60.out 
tail  -32  *m35_canvas*.out>  m35_canvas.winners.out 

ndhash  ../targets/targets.txt  m60  0  30  12  16  18  >  m60.0.30.out 
ndhash  ../targets/targets.txt  m60  0  45  22  30  36  >  m60.0.45.out 
ndhash  ../targets/targets.txt  m60  0  60  14  20  24  >  m60.0.60.out 
tail  -32  *m60*.out  >  m60.winners.out 

ndhash  ../targets/targets.txt  hum_troop  0  30  17  24  28  >  hum_troop.0.30.out 
tail  -32  *hum_troop*.out  >  hum_troop.winners.out 

ndhash  ../targets/targets.txt  m35  0  30  12  24  28  >  m35.0.30.out 
tail  -32  *m35.0*.out  >  m35.winners.out 


RUN2  Run  Script: 

ndhash  ../targets/targets.txt  hum_cargo  0  30  7  16  18  10  >  hum_cargo.0.30.noisel0.out 
ndhash  ../targets/targets.txt  ml  13  0  30  7  10  12  10  >  ml  13.0.30.noisel0.out 
ndhash  ../targets/targets.txt  m35_canvas  0  30  9  18  22  10  >  m35_canvas.0.30.noisel0.out 
ndhash  ../targets/targets.txt  m60  0  30  12  16  18  10  >  m60.0.30.noisel0.out 
tail  -32  *noise*.out  >  winners.noise.out 
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APPENDIX  B. 

3D  HASH  POINT  DATA  SETS 


Synthetic  LADAR  range  images  had  been  previously  generated  by  NYU  for  another 
project  from  the  Ballistic  Research  Laboratory  computer  aided  design  models  for  six  tactical 
vehicles  (targets)  using  the  LARRA/SAIL  modeling  program.  The  targets  were  the  M60-A3 
tank,  Ml  13  armored  personnel  carrier  (APC),  M3 5  truck  with  a  rack  and  canvas  cover,  M3 5 
truck  without  a  rack  or  canvas  cover,  HMMWV  troop  version  with  the  conventional  sloped  rear 
and  HMMWV  cargo  version  which  has  a  square  back.  These  images  were  generated  at  a  sensor 
depression  angle  of  zero  degrees.  Images  were  created  every  15  degrees  azimuth  and  elevation 
with  each  pixel  corresponding  to  a  ray  trace.  All  output  images  are  in  the  Khoros  viff  format. 

For  these  six  targets,  images  at  every  30°  were  selected  to  use  to  build  up  a  data  base  of 
72  models  consisting  of  12  orientations  for  the  6  targets.  Since  geometric  hashing  operates  as  a 
recognition/identification  process  on  a  subimage  corresponding  to  a  region  of  interest  or  "image 
chip",  a  pseudo  backgroimd  image  was  created  in  which  to  insert  these  targets.  This  raw  image 
chip  was  sized  at  100  rows  by  150  columns  and  Gaussian  random  noise  with  a  mean  value  of  5 
and  a  variance  of  2  was  added  to  every  background  pixel  in  this  raw  image  chip.  The 
LARRA/SAIL  generated  images  were  subsampled  by  a  factor  of  three  and  inserted  into  the 
approximate  center  of  this  raw  image  chip.  This  generated  images  of  the  selected  vehicles 
approximated  targets  at  a  range  of  one  kilometer. 

For  the  ND  Hashing  project,  NYU  extracted  3D  hash  points  from  54  of  these 
LARRA/SAIL-generated  images: 

•  Four  targets  every  30°  in  azimuth:  HMMWV  (cargo),  Ml  13  APC,  M3 5  truck  (canvas 
cover),  and  M60  tank;  these  represent  a  48  model  training  set. 

•  The  same  four  targets  at  a  45°  azimuth,  for  use  as  test  images 

•  HMMWV  (troop)  and  M3  5  truck  (no  canvas),  both  at  30°  azimuth.  These  two  target 
variants  were  also  used  as  test  images. 

The  following  tables  give  the  (x,y,  range)  values  of  each  hash  point  for  each  of  those  54 

targets. 


.  *  A.  Akerman  III,  R.  Patton,  W.  Delashmit,  and  R.  Hummel,  Multisensor  Fusion  Using  FLIR  and  Ladar  Identification.  Final 
Report  N-TR-97-131,  Army  Research  Office,  Contract  DAAH04-93-C-0049,  31  March  1997. 
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Target  Variants:  30°  Azimuth 
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APPENDIX  C. 

Theoretical  Formulation  for  Hashing  of  Ladar  Imagery 


C.l  Model  Building  with  Depth  Values  and  Corner  Points 

The  hash  table  is  constructed  that  encodes  the  information  about  the  models  in  a  view- 
centered  fashion.  Especially  because  we  are  dealing  with  3D  information,  it  may  be  possible  to 
use  a  different  model  representation  strategy.  However,  our  first  object  recognition  strategy  uses 
separate  models  for  every  viewing  direction.  Accordingly,  we  begin  separate  models  for  each 
target  type,  for  each  discretized  viewing  direction.  The  viewpoint  direction  of  the  model  is  a 
two-parameter  collection  of  locations  on  the  "viewing  sphere,"  although  in  our  initial 
experiments,  we  will  assume  a  constant  depression  angle,  and  thus  the  viewpoint  direction 
reduces  to  a  single  parameter. 

The  data  that  are  encoded  for  each  model  are  of  two  types:  relative  depth  data  and  comer 
discontinuities.  That  is,  for  each  model,  we  form  two  sets  of  data,  using  predictions  based  on 
the  model.  One  set  consists  of  the  depth  information  at  a  finely-quantized  two  dimensional  grid 
of  points,  resulting  in  a  set  {(xi,  yj,  zj  )}  of  depth  values.  The  location  of  the  origin  for  this 

collection  is  unimportant,  since  the  values  will  only  be  used  in  terms  of  differences.  The  second 
set  of  data  consists  of  locations  of  comers  that  are  predicted  to  be  visible  along  depth 
discontinuities,  and  can  be  represented  as  a  collection  of  two-dimensional  locations  {(xi,yi)}. 

The  comer  data  can  optionally  be  attributed  with  extra  information,  such  as  a  predicted 
orientation  of  the  angle  bisector  of  the  comer,  when  projected  onto  the  image  plane.  In  this  case, 
the  data  takes  the  form  {(xi,yi,0i)}.  We  reiterate  that  this  information  is  dependent  on  the  model 
m,  and  that  a  model  is  a  target/orientation  pair. 

Next,  we  choose  basis  sets.  A  single  (x,y,z)  location  suffices  to  determine  a  basis  set. 
Theoretically,  we  could  use  all  of  the  depth  data  as  potential  basis  points,  but  we  instead  will 
limit  the  size  of  the  hash  table  and  the  number  of  representations  of  the  model  by  choosing  only 
3D  locations  corresponding  to  comer  detections.  That  is,  for  every  predicted  comer  location 
(  xj,  yj),  we  find  a  corresponding  (xjj,  yjj,  zjj)  in  the  depth  data  that  has  the  same  (or  nearly  the 

same)  (x,y)  coordinates,  and  we  consider  the  index  i  as  a  possible  basis  index  for  the  model  m. 
The  actual  basis  for  index  i  is  located  at  (xjj,  yjj,  zjj). 

We  then  form  hash  table  entries  for  the  model/basis  pair  (mj  j).  There  are  essentially  two 
hash  tables,  corresponding  to  the  two  kinds  of  data.  The  depth  hash  table  consists  of  entries 

{m,i)  =  (x^  ,^4  ,zj  - 

for  all  k  jj.  That  is,  each  position  in  the  model  is  measured  relative  to  the  3D  location  of  the 

basis  point,  and  the  resulting  normalized  positions  become  hash  table  entries  for  the  particular 
model  with  the  particular  basis. 

For  the  comer  data,  we  constmct  entries  from  the  predicted  observable  comers  in  the 
Ladar  data,  normalizing  with  respect  to  the  (x,y)  locations.  Thus  for  every  (x^,  yj^,  00  encoding 
a  comer  location  in  the  model  m,  we  form  a  hash  entry 
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0*  (w,  0  =  (Xi -Xj, ,  -yj, ,  0^ ) 

Thus  the  comer  data  entries  are  relative  (x,y)  positions  with  respect  to  the  basis  point 
location,  together  with  the  predicted  angular  bisector  direction  of  the  comer. 

The  entries  should  additionally  be  endowed  with  covariance  information;  i.e.,  predictions 
about  the  variations  of  the  hash  values  due  to  inaccuracies  in  sensing.  This  information  is 
needed  in  order  to  ensure  that  the  weighted  voting  geometric  hashing  scheme  properly 
implements  a  Bayesian  reasoning  system,  under  the  assumption  that  the  hash  values  of  the 
observed  scene  data  provide  independent  information  (a  conditional  independence  assumption). 
For  our  preliminary  studies,  we  will  use  a  simplified  covariance  estimation  procedure.  Namely, 
for  the  hash  table  entries  (D|f(m,i),  we  assume  a  spherical  distribution  of  values  centered  at  the  3D 
location  of  the  entry,  with  standard  deviation  proportional  to  the  Euclidean  norm  of  the  hash 
value  entry.  For  the  comer  data,  the  entry  coif(m,i)  is  assumed  to  have  circular  variation  in  the 
(x,y)  components  with  standard  deviation  proportional  to  (but  with  a  larger  constant  of 
proportionality)  the  Euclidean  distance  from  the  origin,  and  the  0  component  is  presumed  to  be 
statistically  independent  and  Gaussian  distributed  with  a  fixed  variance. 

C.2  New  Voting  Schema 

Data  is  obtained  on  a  far  coarser  sampling  rate,  and  with  much  greater  noise  than  in  the 
case  of  the  model  data.  Nonetheless,  we  are  able  to  extract  lines,  comers,  and  have  readily 
available  depth  values  from  the  observed  objects. 

We  use  a  comer  detector  to  obtain  potential  basis  points.  Currently,  we  are  using  the 
C++  version  of  the  Cox-Boie  edge  detector,  and  the  line  following  and  coalescing  routines.  We 
have  ported  the  Cox-Boie  edge  detector  to  KHOROS,  displaying  the  results  with  Cantana. 

In  any  case,  image  locations  where  comers  are  detected  are  located.  We  pick  one  such 
point  as  a  candidate  basis  location  (at  location,  say,  (xq,  yo,  zo)),  and  we  perform  a  trial.  The 
algorithm  must  iterate  over  trials  imtil  all  interesting  locations  have  been  explored.  In  a  trial,  we 
perform  hashing  of  the  deteeted  objeet  subimage  and  weighted  voting  of  the  model/basis 
candidates.  Hashing  works  as  follows. 

For  all  pixel  locations  (x,y,z)  near  the  basis  point ,  (xo,  yo,  zo)  in  the  scene,  we  eompute  a 
relative  (§,  t),  Q  =  (x,y,z)  -  (xq,  yo,  zo)  value  for  each  such  point.  The  coordinate  values 
correspond  to  a  differential  distance  from  the  observed  basis  point  location  in  the  scene.  When 
computing  the  depth  value  zo  for  the  basis  point,  we  use  a  local  minimum  of  range  values  in 
order  to  be  sure  that  the  range  is  obtained  for  the  foreground  object,  and  not  the  background. 
Each  such  (4,  ri,  Q  location  becomes  a  hash  value  that  hashes  into  the  three-dimensional  range 
data  hash  table.  We  need  only  concern  ourselves  with  (4,  t],  Q  values  that  are  sufficiently  small 
that  they  could  plausibly  be  on  the  same  target  as  the  basis  point. 

Likewise,  nearby  extracted  comers  are  used  to  compute  a  location  (^,t|,  0)  giving  a 
relative  position  to  the  basis  point  and  the  orientation  of  the  angle  bisector.  This  value  hashes 
into  the  three-dimensional  comer-values  hash  table. 
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For  each  range-based  hash,  say  (^,  r],  Q,  nearby  entries  are  located  in  the  hash  table.  For 
each  entry  of  the  form  ©u(m,i)  that  is  located  near  (^,  t|,  Q  a  search  is  made  for  the  entry 

©]j(m,i)  that  is  closest  to  (^,  t],  Q.  Since  the  entries  of  the  form  ©q(m,i)  form  a  "sheet" 
representing  the  surface  of  the  object,  they  will  be  located  quite  densely,  and  the  entry  ©]j^(m,i) 
that  is  nearest  (^,  t|,  Q  will  be  the  nearest  point  on  this  surface. 


Recall  that  M]j(m,i)  is  located  at  (xj^,  yi^,  zj^)  -  (xjj,  yjj,  zjj).  This  entry  then  receives  a 
vote,  which  replaces  its  current  vote  only  if  it  is  greater  than  its  current  vote.  All  votes  are 
initially  zero.  The  vote  for  entry  ®k(m,i)  is  denoted  by  zif(m,i),  and  the  vote  amount,  for  the 

depth  data,  depends  on  the  distance  from  the  point  (^,  t|,  Q  to  the  sheet,  at  point  ©if(m,i).  If  the 
(x,y)  coordinate  locations  are  far  apart,  then  the  observed  point  is  not  occurring  "in  front"  of  the 
model,  and  the  vote  will  be  zero.  However,  ordinarily,  if  there  is  one  point  of  the  sheet  nearby, 
then  the  nearest  point  will  be  perpendicular  to  the  hash  point,  which  in  the  nearly  orthogonal 
projection,  means  that  the  (x,y)  components  nearly  match.  In  this  case,  the  distance  d  is 
essentially  the  different  in  the  z  components. 


The  vote  should  be  large  if  this  distance  d  is  small,  and  will  be  negative  if  the  distance  is 
large.  The  Bayesian  theory  says  that  the  value  should  be 


z*(/n,0  =  log 


where  the  Prob's  measure  density  distribution  values  at  the  location  of  the  hash,  and  the 
condition  in  the  mmierator  means  that  it  is  known  that  the  model  m  appears  with  basis  point  i  at 
location  (xo,  yo,  zo).  To  model  this  vote,  we  use  the  formula 


=  log 


^/2 


/ra 


=  c^- 


where  d  is  the  distance  between  (^,  r),  Q  and  ^nd  cti  and  aa  are  constants  discussed 

below. 


The  value  is  expected  depth  variation  (the  standard  deviation  value,  actually)  due  to 

sensor  noise,  measurement  noise,  and  also  changes  in  the  vehicle  at  any  given  location.  The 
units  are  in  length  and  so  for  a  high  quality  sensor,  are  likely  to  be  on  the  order  of  a  foot  or  two. 
The  value  of  ci  is  the  standard  deviation  for  point  to  point  variations  of  depth,  without  any  other 
knowledge.  The  value  of  Cj  is  (l/2)log(a2/ai),  and  the  coefficient  C2  is  simply  (1/2ct^2)- 

(l/2a  i).  Presumably,  the  weighted  vote  should  saturate  at  some  negative  amount,  and  not  get 
too  negative,  reflecting  the  fact  that  a  sensor  drop-out  is  possible.  Also,  this  formula  could  easily 
be  modified  to  account  for  the  fact  that  the  gi  value  should  be  larger  for  positive  values  of  d. 
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(representing  the  possibility  of  occlusion  of  the  model)  than  for  negative  values  of  d  (which 
would  occur  when  the  model  has  a  hole  in  it). 


For  hashes  of  comer  detections,  a  similar  formula  operates.  That  is,  a  hash  to  location 
(x,y,  0)  is  used  to  locate  nearby  entries  of  the  form  (oij^(m,i).  In  this  case,  because  comer 
detections  are  wdl  separated  for  any  given  model/basis  combination^there  is  no  need  to  search 
for  the  nearest  co  entry  with  model/basis  (m,i).  A  weighted  vote  z]j(m,i)  is  recorded  for  the 
entry.  This  time,  the  "distance"  between  the  hash  point  and  the  entry  can  be  measured  by  a 
weighted  sum  of  the  square  distance  in  the  (x,y)  plane,  and  the  square  difference  in  the  0 
variable.  The  z  component  plays  no  role  because  it  has  already  been  accounted  in  the  depth 
hashes.  The  weights  will  depend  on  the  expected  variations.  Let  d^  represent  the  weighted  sum 
of  square  differences.  That  is, 


(f  =a,[(x^  -Xj,  -xf  +0*  -yj,  -yf\  +a^{d^  -6) 


Here,  the  weights  ai  and  a2  will  have  to  be  determined  empirically.  Then  the  formula  for  the 
weighted  vote  is  similar  to  before: 

=  q  -  C2d^ 


Again,  the  value  should  be  clipped  if  it  bewmes  too  negative.  Also,  only  comers  near 
the  basis  point  need  be  considered.  Here,  the  Ci  and  C2  values  depend  on  two  standard 
deviation  values,  ai  and  02,  just  as  above,  where  the  first  represents  expected  distances  of  the 
comers  from  nearby  comer  entries  given  knowledge  of  the  placement  of  the  model,  and  the  02 
entry  corresponds  to  a  priori  distance  deviations. 


Finally,  votes  are  combined.  The  total  weighted  vote  for  any  given  model/basis  is  a  sum 
of  the  weighted  votes  for  all  entries  bases  on  the  model/basis: 

i  / 


This  sum  is  performed  over  all  model/basis  sets,  and  model/bases  that  receive  a  large 
weighted  vote  are  candidate  detections. 

The  result  is  that  a  model  that  is  likely  to  be  present  will  receive  a  large  corresponding 
vote  for  some  (m,i)  pair,  providing  the  chosen  basis  location ,  (xo,  yo,  zo)  lies  near  a  comer  of  a 
model  point.  We  thus  see  that  it  is  extremely  important  to  be  able  to  extract  from  the  detected 
subimage  basis  points  (in  our  case,  comer  points)  that  correspond  to  comer  points  pre-stored  as 
basis  points  in  the  models. 
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